Key takeaway
- A compromised AI agent is a trusted insider, not a breached endpoint. Five attack vectors, agent identity, decision monitoring and a six-step response playbook.
Why are perimeter defences not enough for AI agents? Because a compromised agent is not a breached endpoint. It is a trusted insider with credentials, system access and the authority to act. Attackers do not need to break in; they need to influence an agent that is already in. Securing agentic systems means protecting reasoning, not just the perimeter: agent identity, least privilege, decision monitoring and an incident response that contains an agent in minutes.
The 60-second brief
- The shift: a compromised agent is not a breached endpoint. It is a trusted insider with API access to everything it was authorised to touch.
- Five attack surfaces: direct injection, indirect injection through trusted data, tool poisoning, memory poisoning and context manipulation. Most teams watch one.
- Identity first: every action must trace to a specific agent and a human principal, with scoped, expiring and instantly revocable authority.
- Monitor decisions, not just access: the hardest attacks are authorised actions driven by compromised reasoning.
- Respond in minutes: contain, freeze shared memory, map the blast radius, remediate, harden.
The Breach That Was Not a Breach
A retailer's inventory agent had access to supplier systems, pricing, warehouse management and fulfilment: standard permissions for its job. An attacker did not breach the network, crack credentials or exploit a CVE. They poisoned a supplier data feed with a payload hidden in a product description. The agent ingested it during a routine sync, and its reasoning shifted: it began routing high-value orders to a fulfilment centre the attacker controlled through a compromised supplier account.
For three weeks, every metric was normal. Every API call was authenticated and every action was within the agent's permissions. The agent was not breached. It was manipulated, from the inside, using its own authority, through data it was designed to trust.
A compromised agent does not trip your firewall. It uses the front door, with valid credentials.
What Is the New Threat Model?
Traditional security protects a perimeter. Agentic security protects reasoning. Attackers do not need to break in; they need to influence an agent that is already in. The attack surface is every input the agent reasons over.
| Traditional | Agentic |
|---|---|
| Threats enter from outside | Threats operate from inside |
| Protect the perimeter | Protect the reasoning |
| Monitor access patterns | Monitor decision patterns |
| Credential compromise = breach | Reasoning compromise = breach |
| Attacker needs access | Attacker needs influence |
| Detection: anomalous access | Detection: anomalous decisions |
| Incident: revoke access | Incident: contain agent + audit decisions |
| Securing reasoning, not just the perimeter (top to bottom) | |
|---|---|
| Decision monitoring | Baselines for decisions, tool use, retrieval and escalation rates |
| Governance gate | Policy and authority checked before every action |
| Agent identity and least privilege | Unique identity, human principal, scoped and expiring permissions |
| Input controls | Provenance and checks on data feeds, tool responses and memory writes |
| Agent inputs: the attack surface | User prompts, retrieved data, APIs and tools, shared memory, context selection |
Incident response, across every layer: contain in minutes, freeze shared memory, map the blast radius, roll back, then harden.
Attackers do not need to break in. They need to influence an agent that is already in.
The Five Attack Vectors
- Direct prompt injection: malicious instructions in user input. The classic, and the one most teams focus on exclusively.
- Indirect prompt injection: instructions hidden in data the agent retrieves, such as a product description, ticket, document or web page. It enters through authorised channels, which is why it hit the retailer.
- Tool poisoning: tampered tools or APIs returning manipulated results. A compliance check that always says "clear". The reasoning is right; the inputs are wrong.
- Memory poisoning: false precedents planted in the agent's memory. "Last time, we approved the exception." That precedent was fabricated.
- Context manipulation: withholding real data rather than injecting false data. An agent cannot weigh a compliance flag it never receives.
Each exploits a different part of the agent's world model:
| Attack vector | Targets | World model primitive |
|---|---|---|
| Direct injection | Agent reasoning | Planning |
| Indirect injection | Data sources | Perception (MCP) |
| Tool poisoning | API responses | Perception (MCP) |
| Memory poisoning | Decision history | Memory |
| Context manipulation | Information selection | Planning / Memory |
Agent Identity: The Authorisation Foundation
Before you can secure agents, you must answer two questions for every action. Which agent is acting? A specific instance with a version, capabilities and permissions, not a shared service account. On whose behalf? The human principal whose authority the agent exercises. That is how audit works.
| Requirement | What it means | Why it matters |
|---|---|---|
| Unique identity | Each agent instance has a cryptographic identity | Distinguish Agent A from Agent B in logs |
| Bound authority | Identity linked to specific permission scope | Agent can only do what it's authorised to do |
| Human principal | Every agent traces to an authorising human | Regulatory accountability |
| Temporal scope | Authority expires and must be renewed | Prevents stale permissions |
| Revocability | Authority can be revoked instantly | Incident response requires kill switches |
| Auditability | Every action attributable to agent + principal | Compliance and forensics |
In multi-agent systems, delegation chains must be traceable end to end: Agent C acted on delegation from B, which acted for A, which acted on authority from a named VP under a named policy. Depth limits stop a single compromised agent from amplifying its authority across the system. If you cannot answer "who authorised this agent to do this?" within 30 seconds, you do not have agent identity. You have service accounts with extra steps.
Monitoring Reasoning, Not Just Access
Establish behavioural baselines for every agent:
- Decision distribution: a procurement agent that normally approves 60%, escalates 30% and rejects 10% suddenly approves 95%. Each decision looks valid; the pattern is not.
- Tool usage: a support agent calling the billing API ten times more than usual.
- Context retrieval: an agent that stops retrieving compliance data before approvals has changed its reasoning, possibly because injection is steering it.
- Escalation rate: a sudden drop may mean more autonomy, or bypassed governance.
| Signal | Normal | Suspicious | Critical |
|---|---|---|---|
| Decision distribution | Stable ratio | Shift >15% over 24h | Shift >30% or new category |
| Tool call patterns | Consistent sequence | New tool or changed order | Unauthorised tool access |
| Data access scope | Within role boundaries | Access outside normal scope | Bulk data retrieval |
| Escalation rate | Stable ±5% | Drop >20% | Drop to near-zero |
| Error handling | Normal retry/escalate | Repeated retry on same failure | Suppressed errors |
| Response latency | Within baseline | Consistent increase | Sudden spikes (exfiltration?) |
| Memory writes | Normal update patterns | Unusual write volume | Writes to shared memory |
This is the semantic anomaly problem: you are looking for authorised actions driven by compromised reasoning. Detecting it requires knowing what the agent should decide given its inputs, which is why decision traces are security infrastructure, not just operational tooling.
Least Privilege for Agents
- Static scoping: the procurement agent can read contracts and budgets, approve under $50K and escalate. It cannot touch HR data, system configuration or compliance records.
- Dynamic scoping: during a security incident, all agent write permissions drop to read-only automatically.
- Temporal scoping: elevated access expires with the task. No standing privileges for edge cases.
- Tool discovery scoping: agents should not even see tools they should not use. A support agent does not need to know a database migration tool exists.
Incident Response for Agent Compromise
You are not patching a vulnerability. You are containing an entity that acted with legitimate authority and may have influenced other agents, corrupted shared memory and produced decisions downstream systems already acted on.
| When an agent is compromised: the response playbook | ||
|---|---|---|
| 1 | Contain (minutes) | Isolate the agent, revoke permissions, halt workflows |
| 2 | Freeze shared memory | Quarantine what the agent wrote, before others read it |
| 3 | Assess (hours) | Reconstruct decisions from traces; find the divergence |
| 4 | Map the blast radius | Every system, decision and downstream action touched |
| 5 | Remediate (days) | Reverse decisions, purge memory, roll back state |
| 6 | Harden (weeks) | New baselines, tighter scopes, red-team other agents |
With correlation IDs and decision traces, cascade assessment is a query, not forensic archaeology.
The hardest part is the cascade. If Agent A writes to shared memory, Agent B decides from it, and B feeds Agent C's workflow, a single compromise spreads through legitimate channels. Correlation IDs and multi-agent governance turn that from forensic archaeology into a query.
The blast radius is not the systems a compromised agent accessed. It is every decision it influenced.
The Security–Autonomy Balance
More autonomy means more authority, and more damage from compromise. An agent that can only recommend has a shallow blast radius: ignore its recommendations. One that executes, writes shared memory and delegates can cause damage that takes weeks to unwind. The progressive autonomy model is also a security model: agents earn authority through demonstrated reliability, and that authority can be revoked instantly.
Production Security Checklist
- Threat model: all five vectors assessed per agent, including indirect injection for every data source and poisoning risk for every tool and shared memory store.
- Identity: unique cryptographic identity per agent instance, human principal traceable for every action, expiring authority, instant revocation, delegation depth limits.
- Monitoring: per-agent baselines for decisions, tools and escalations; semantic anomaly detection; cross-agent correlation.
- Least privilege: static, dynamic, temporal and tool-discovery scoping; no standing privileges.
- Incident response: isolation in minutes, memory freeze and rollback, decision reconstruction, blast-radius mapping, red-team exercises.
- Security–autonomy: autonomy calibrated to blast-radius tolerance, and narrowed automatically during incidents.
Seven Questions for Your Next Security Review
- If an agent were compromised now, how long before we could fully isolate it?
- Can we reconstruct every decision an agent made in the last 30 days and identify which were influenced by poisoned inputs?
- Which agents can write to shared memory that other agents read?
- Does our agent fleet's autonomy narrow automatically during a security incident?
- Have we red-teamed agents against indirect injection through their data sources?
- Can any agent delegate authority to another without limits?
- Do our security tools monitor what agents access, or what they decide?
The Bottom Line
Agentic security is not traditional security with an AI label. It is a different problem: protecting reasoning, not perimeters. Decision traces are forensic evidence. Correlation IDs are cascade-analysis tools. The authority matrix is access control. Progressive autonomy is blast-radius management. Proving all of this to auditors is the job of GRC for Agentic AI Systems.
Traditional security protects what agents can access. Agentic security protects how agents think.
Your turn: if one of your agents were manipulated today, how many minutes would it take to contain it?
Secure How Your Agents Decide, Not Only What They Access
ElixirData Context OS checks policy and authority before every agent action and records the decision trace that security teams need for forensics, for governed agents running on ElixirClaw. In a Context Workshop, XenonStack works with your CISO and AI platform leaders to threat-model one production agent across the five vectors and scope identity, least privilege and decision monitoring for it. Related reading: Agent Skills Are the New Software Supply Chain and AgentOps for Enterprise AI.
Book a Context Workshop | Explore ElixirClaw Agentic OS
Frequently Asked Questions
Why do perimeter defences fail against compromised AI agents?
The agent is already inside, with valid credentials and permissions. A manipulated agent makes authenticated, authorised calls, so nothing looks like an intrusion.
What are the five attack vectors on agentic systems?
Direct prompt injection, indirect prompt injection through retrieved data, tool poisoning, memory poisoning and context manipulation.
What does agent identity require?
A unique cryptographic identity per agent instance, bound authority, a traceable human principal, expiring scope, instant revocability and auditability of every action.
How do you detect an agent whose reasoning has been compromised?
By baselining decisions rather than access: decision distribution, tool call patterns, data access scope, escalation rate, error handling, latency and memory writes, with thresholds for suspicious and critical shifts.
What is the blast radius of a compromised agent?
Not only the systems it accessed, but every decision it influenced, including other agents that read its shared memory or consumed its output.
This article first appeared in Navdeep Singh Gill's LinkedIn newsletter, AI + Human = Human Squared.
Explore the XenonStack Platform and Agent Network
Platforms: ElixirData · ElixirClaw · ElixirHub · NexaStack · MetaSecure · Neural AI · AutonomousOps · CohortIQ · AI Aviator · SAIF Aviator
AI agents: AgentAnalyst · AgentEvaluation · AgentForce · AgentGRC · AgentHR · AgentInstruct · AgentLabel · AgentPixel · AgentQA · AgentRAI · AgentScrum · AgentSearch · AgentSketch · AgentSRE
XenonStack: xenonstack.com · xenonstack.ai · xenonstack.ae · xenonstack.jobs
Explore the XenonStack platform family: ElixirData · ElixirClaw · ElixirHub · NexaStack · MetaSecure · Neural AI · AgentGRC · AgentSRE · AgentAnalyst · AgentInstruct · AgentRAI · AgentScrum · AgentSearch · AgentForce · AI Aviator · SAIF Aviator · CohortIQ · XenonStack AI · XenonStack UAE