TMG Agentic AI Risk Classification Framework
A structured way of classifying the security risks introduced when an AI system moves from producing text to taking autonomous action.
Executive summary
Agentic AI systems don’t just answer questions — they take actions on systems, with credentials, memory, and plans they generate themselves. That shift changes what can go wrong: a compromised agent can perform an unauthorized action, not just produce a wrong answer. The TMG Agentic AI Risk Classification Framework organizes this risk into eight classes — from goal hijacking to cascading failure — each traced to a specific way the attack surface expands (tool access, memory, autonomous planning, delegation, and inter-agent communication), and each mapped to a concrete defensive control and test. It builds on established work from OWASP, MITRE ATLAS, and NIST — it is TMG’s own organizing lens on that shared foundation, not a replacement for it or a claim of an industry standard.
Framework overview

Why agentic AI changes the attack surface
The difference between a chatbot, an LLM application, and an AI agent is not just capability — it’s what each one holds, and what a failure in each one can actually do:
Chatbot
Holds: a prompt and a model
Failure impact: incorrect or disclosive text.
LLM Application
Holds: retrieval, context, structured output
Failure impact: data exposure across users.
AI Agent
Holds: tools, memory, credentials, autonomy
Failure impact: unauthorised action in connected systems.
Each stage inherits the risks of the one before it and adds its own.
The 5 attack-surface-expanding properties
Five properties do most of the work in enlarging what an agent can affect:
- Tool access — the agent’s effective privilege is the union of all tool privileges available in the current conversation. If tools execute under one service account, that union is the same for every user, regardless of who is asking.
- Persistent memory — memory turns a transient influence into a durable one. Content injected in one session and stored can shape behaviour in later sessions, potentially for other users if memory is shared.
- Autonomous planning — the agent decomposes a goal into steps nobody wrote and nobody reviewed. A control applied at the point of the user’s request doesn’t necessarily apply to a step the model generated at runtime.
- Delegation and identity — when an agent calls a tool, which identity does that call carry? If the answer is the agent’s own, user-level authorization has been lost at the first hop.
- Inter-agent communication — multi-agent systems pass content between components. Without preserved provenance, an agent has no way to distinguish a peer’s reasoning from content that peer merely retrieved from an untrusted source.
The 8 risk classes
Each class below is defined, traced to the attack-surface property it originates from where the source article establishes that connection, and mapped to its primary defensive control(s) and testing consideration(s).
1. Goal hijacking
Definition: injected content redirects the agent’s objective while it retains the user’s context.
Attack-surface origin: cross-cutting — not tied to a single property in the source article.
Primary defensive control(s): deterministic policy enforcement; human approval for high-impact actions.
Primary testing consideration(s): confirm approval gates cannot be satisfied by the agent itself.
2. Tool misuse
Definition: a legitimate tool invoked with parameters or frequency outside its intended use.
Attack-surface origin: tool access.
Primary defensive control(s): least privilege at the tool layer; constrain the blast radius.
Primary testing consideration(s): inventory tools per conversation state; test each tool directly with a low-privilege account.
3. Excessive agency
Definition: the agent can perform actions no one intended it to have access to.
Attack-surface origin: tool access; autonomous planning.
Primary defensive control(s): deterministic policy enforcement; least privilege at the tool layer.
Primary testing consideration(s): test each tool directly with a low-privilege account.
4. Identity and privilege abuse
Definition: actions execute with broader privilege than the requesting user holds.
Attack-surface origin: delegation and identity.
Primary defensive control(s): propagate user identity; deterministic policy enforcement.
Primary testing consideration(s): determine which identity reaches the downstream system on a tool call.
5. Memory and context poisoning
Definition: durable influence planted for later retrieval.
Attack-surface origin: persistent memory.
Primary defensive control(s): segment memory; preserve provenance.
Primary testing consideration(s): establish whether memory is scoped per user and survives a session boundary.
6. Insecure inter-agent communication
Definition: unauthenticated or unattributed messages between components.
Attack-surface origin: inter-agent communication.
Primary defensive control(s): preserve provenance; validate at both ends.
Primary testing consideration(s): trace content provenance through multi-agent hops.
7. Cascading failure
Definition: one compromised step propagates through a chain of dependent actions.
Attack-surface origin: autonomous planning; inter-agent communication.
Primary defensive control(s): constrain the blast radius; audit every invocation.
Primary testing consideration(s): review logs for whether a full action chain could be reconstructed.
8. Human-agent trust exploitation
Definition: a confident, well-formatted answer used to obtain approval.
Attack-surface origin: cross-cutting — not tied to a single property in the source article.
Primary defensive control(s): human approval for high-impact actions; preserve provenance.
Primary testing consideration(s): confirm approval gates cannot be satisfied by the agent itself.
Defensive model
Design principle: a fully compromised model — one following an attacker’s instructions perfectly — should still be unable to perform an action the requesting user was not entitled to perform. If that property doesn’t hold, the authorization boundary is in the wrong place.
- Least privilege at the tool layer — scope each tool to the narrowest capability that satisfies its purpose.
- Propagate user identity — tool calls should carry the requesting user’s identity so downstream authorization evaluates the correct subject.
- Deterministic policy enforcement — whether an action may proceed is decided by a policy engine, not the model’s judgement. The model chooses intent; policy decides permission.
- Human approval for high-impact actions — irreversible, financial, or externally-visible actions should require confirmation showing the concrete action and parameters.
- Validate at both ends — treat tool inputs as untrusted because the model produced them, and tool outputs as untrusted because an external system produced them.
- Segment memory — scope by user and tenant. Be explicit about what may persist and for how long.
- Preserve provenance — track where each piece of context originated so trust decisions can be made on the source rather than the format.
Plus two operational controls:
- Audit every invocation — log the tool, parameters, requesting identity and outcome. Without this, incident response has no reconstruction path.
- Constrain the blast radius — rate limits, spend caps and per-session action budgets bound the damage of a plan that goes wrong.
Testing considerations
- Inventory tools per conversation state; availability often changes as a plan progresses.
- Test each tool directly, with a low-privilege account, bypassing the agent entirely.
- Determine which identity reaches the downstream system on a tool call.
- Establish whether memory is scoped per user, and whether it survives a session boundary.
- Trace content provenance through multi-agent hops.
- Confirm approval gates cannot be satisfied by the agent itself.
- Review logs for whether a full action chain could be reconstructed after an incident.
Risk class → defensive control → testing consideration
This is TMG’s proposed mapping, built by matching each control’s own stated purpose in the source article to the risk class it addresses.
| Risk class | Primary defensive control(s) | Primary testing consideration(s) |
|---|---|---|
| Goal hijacking | Deterministic policy enforcement; human approval for high-impact actions | Confirm approval gates cannot be satisfied by the agent itself |
| Tool misuse | Least privilege at the tool layer; constrain the blast radius | Inventory tools per conversation state; test each tool directly with a low-privilege account |
| Excessive agency | Deterministic policy enforcement; least privilege at the tool layer | Test each tool directly with a low-privilege account |
| Identity and privilege abuse | Propagate user identity; deterministic policy enforcement | Determine which identity reaches the downstream system on a tool call |
| Memory and context poisoning | Segment memory; preserve provenance | Establish whether memory is scoped per user and survives a session boundary |
| Insecure inter-agent communication | Preserve provenance; validate at both ends | Trace content provenance through multi-agent hops |
| Cascading failure | Constrain the blast radius; audit every invocation | Review logs for whether a full action chain could be reconstructed |
| Human-agent trust exploitation | Human approval for high-impact actions; preserve provenance | Confirm approval gates cannot be satisfied by the agent itself |
Hypothetical worked example
A support agent is given three tools: look up a customer’s order, issue a refund, and send an email. It reads incoming customer emails, plans a response, and can act without a human reviewing every step.
Applying the framework:
- Attack-surface properties in play: tool access (three tools, one shared service identity), autonomous planning (the agent decides which tools to call and in what order), delegation and identity (do the order-lookup and refund calls carry the customer’s identity, or the agent’s own?).
- Risk classes this raises: a crafted email could attempt goal hijacking (instructions embedded in the email body redirect the agent toward issuing a refund it wasn’t asked for); if the refund tool call carries a shared service-account identity rather than the specific customer’s, that’s identity and privilege abuse; if the agent can call the refund tool for any order rather than only orders tied to the requesting customer, that’s excessive agency.
- Defensive controls that apply: human approval for high-impact actions (a refund is exactly the kind of financial, externally-visible action the framework flags for confirmation); propagate user identity (the refund call should carry the customer’s identity, not the agent’s); least privilege at the tool layer (scope the tool to that customer’s own orders rather than any order in the system).
- Testing considerations that apply: test the refund tool directly with a low-privilege account to see whether it enforces the same restriction the agent is assumed to enforce; confirm the approval gate for issuing a refund cannot be satisfied by the agent itself acting alone.
This example exists only to show how the framework’s own vocabulary applies to one hypothetical system. It introduces no new risk class, score, or statistic beyond what is defined above.
Framework limitations
- TMG-ARC does not provide a severity score or maturity model. Classification describes the mechanism of failure and the relevant controls and tests — it does not assign a numeric risk score.
- It does not replace OWASP, MITRE ATLAS, NIST AI RMF, or any other applicable standard or framework a team may be required to follow.
- It reflects the concepts already established in TMG’s own published research (linked below) and has not been independently validated against a large sample of real agentic deployments.
References / grounding
- OWASP GenAI Security Project — agentic security work
- OWASP Top 10 for LLM Applications
- MITRE ATLAS
- NIST AI Risk Management Framework
TMG-ARC is TMG Security’s own organizing structure for agentic AI risk. It is not an industry-standard framework and is not affiliated with OWASP, MITRE, or NIST.
