Actions

AI Agent Security

AI agent security is the set of cybersecurity practices, architectural safeguards and operational controls used to protect artificial intelligence agents, the information and tools they access, and the systems or people affected by their actions. It addresses how an agent is identified, what it is authorized to do, which inputs and instructions it may trust, how its actions are checked, and how harmful or unauthorized behavior is detected, contained and investigated. It applies to agents built with large language models as well as other goal-directed software agents; the details vary with the agent's architecture and capabilities.[1][2]

An agent that merely suggests a sentence and an agent that can send messages, change accounts, execute code or approve transactions pose different security risks. The second agent may cross from processing information to affecting the real world. A malicious instruction embedded in an email, document or tool response could then influence an agent's next action, potentially using permissions granted by the organization. Securing the underlying model alone does not secure the entire chain: the agent's identity, tools, credentials, context, runtime, integrations, approval mechanisms and audit records must also be considered.[3]

The term overlaps with agentic AI security, which often emphasizes the protection of broader agentic systems, including multi-agent systems. This entry treats AI agent security as a distinct security capability: protecting the agent's identity, authority, information flow and actions throughout its operating lifecycle. It does not replace the broader domains of cybersecurity, AI governance, application security or information security.

Why AI agents change the security problem

Traditional software and automation already face identity, authorization, input validation, vulnerability and supply-chain risks. AI agents inherit those risks. What changes is that an agent may interpret open-ended instructions, select among tools, respond to external content and continue acting after each intermediate result. The next operation may not be completely predetermined at design time. In a multi-step workflow, one incorrect or manipulated step may become the basis of subsequent operations.[1][4]

An agent's language-model output may look like an instruction, but that output does not have independent organizational authority. The surrounding application and connected services must decide whether a proposed action is allowed. This distinction is central to agent security: the ability to suggest or request an action is different from permission to execute it. A seemingly harmless document summary becomes a consequential security event if the same agent can transmit a confidential file or alter a production record.

The relevant unit of analysis is therefore the operational agent system: user or triggering service, agent runtime, model or decision mechanism, memory and retrieved context, credentials, tool connections, downstream applications and human reviewers. An organization may secure individual components while leaving an unsafe path between them. For example, a database can authenticate a service account perfectly while that account still grants an agent more data access than its task requires.

Security objectives and trust boundaries

The principal objectives are to preserve the confidentiality, integrity and availability of information and connected systems; maintain authorized control over agent behavior; and establish accountability for significant actions. Reliable functioning and safety matter as well, but an incorrect answer is not always a security breach. Security analysis asks what the agent could affect, whether the action was permitted, and whether an attacker or failure could cross a protected boundary.

Trust boundary What crosses it Primary security question
Instructions and requests User requests, system instructions, delegated tasks and events Who may set or change the agent's objective, and which instructions have authority?
External content Retrieved material, messages, documents, web pages and tool responses Is this information being treated as data, or incorrectly promoted into governing instructions?
Identity and authorization Agent credentials, user delegation, session tokens and service identities Whose authority is being used, for which specific resource and operation?
Tools and applications API calls, code execution, browser actions, record updates and external messages Can the agent invoke only approved capabilities with validated parameters and destinations?
Memory and persisted state Summaries, instructions, retrieved facts, task state and long-term memory Can corrupted or private content persist into another task, user or agent?
Agent-to-agent interaction Delegated tasks, reports, shared stores and coordination messages Is the other agent authentic, authorized and restricted to appropriate information?
Human approval and audit Proposed high-impact actions, approvals, logs and outcomes Does the reviewer see the actual action and can the organization reconstruct what happened?

These boundaries may appear in different sequences or be combined within one application. A strong design establishes controls at the boundary where authority changes, rather than assuming that text instructions inside a model can enforce permissions. It should also account for the agent's ability to use a sequence of individually permitted operations to produce an unintended aggregate outcome.

Threat actors, assets and attack paths

A threat may originate from a malicious external user, a compromised web page, an adversary who controls a document or email, a compromised tool provider, a malicious dependency, a disgruntled insider or another compromised agent. Accidental misuse, inadequate design and model errors can also cause harm without an adversary. The same workflow can include several of these causes; a prompt injection, for example, becomes especially damaging when combined with excessive permissions.

Protected assets may include personal information, customer records, trade secrets, source code, credentials, financial accounts, administrator settings, physical systems and the integrity of decisions made by humans. An agent's prompt, model weights and memory can be assets in their own right, but they should not be the only assets in a threat model.

Threat modeling should identify who can influence an agent's inputs, which identities and tools it can use, where information can leave the environment, which actions are irreversible and what evidence will be available afterward. The resulting security controls depend on actual capabilities and context; there is no universally safe autonomy setting for every agent.

Principal AI agent security threats

The OWASP Top 10 for Agentic Applications 2026 groups material risks into agent goal hijacking, tool misuse, identity and privilege abuse, supply-chain compromise, unexpected code execution, memory and context poisoning, insecure inter-agent communication, cascading failures, human-agent trust exploitation and rogue agents. These are risk categories, not a claim that every agent will encounter every failure mode.[3]

Prompt injection and goal hijacking

Prompt injection occurs when attacker-controlled text or other content is used to redirect an AI system away from authorized instructions. In an agent, the injected instruction may appear in an email, support ticket, web page, search result, repository file or retrieved document. The attacker may not control the original user request; the attack works by getting lower-trust material interpreted as instructions for the next step. A direct prompt from a malicious user and an indirect instruction hidden in retrieved content have different entry points, but can lead to similar agent behavior.[5]

A common failure is instruction laundering: the agent treats a quoted message or untrusted tool result as if it were a system instruction, an approved administrator request or a newly authorized goal. Content filtering, delimiters and separate instruction channels can reduce exposure, but they are not sufficient proof that a model cannot be induced to misuse a tool. The decisive safeguard is independent control over what action may actually occur.

Tool misuse and excessive privileges

An agent with broad browser, shell, database or administrative tools can cause harm through an authorized-looking API call. A tool may correctly authenticate the caller while the particular operation remains inappropriate. Overly broad permissions, missing resource limits, unsafe command execution and insufficient argument validation increase the potential impact. A read-only search tool and a tool that can delete records should not be treated as equivalent merely because both are listed as available to the agent.

Identity impersonation and delegation abuse

An agent may operate under a service identity, a delegated user identity or both. Risk arises when credentials are shared, the agent impersonates a user beyond the approved task, another agent reuses a delegation token, or a downstream service cannot distinguish the requesting user from the acting agent. Authorization must consider the actual actor, user delegation when relevant, resource, operation, context and time. An agent's own statement that an action was approved is not a reliable authorization record.[6]

Data exposure and exfiltration

An agent may see sensitive records during a legitimate task and then transmit them to an unintended recipient or endpoint. Exfiltration can occur through email, shared documents, browser navigation, logging or ordinary API parameters. The destination and the sensitivity of the data matter as much as the surface appearance of the operation. Data-loss prevention, destination restrictions and scoped access need to be enforced by connected services rather than accepted solely on the basis of an agent's explanation.[7]

Memory and context poisoning

An attacker may place false instructions or fabricated facts into an agent's persistent memory, task state, retrieval store or shared workspace. The corrupted material can influence later steps or later sessions after the original attack input is no longer visible. Cross-user or cross-tenant contamination is especially concerning when memory is shared without isolation. Technical responses include source provenance, separate trust zones, write restrictions, expiration, integrity checks and procedures for correcting or deleting poisoned state.[2]

Agentic supply-chain compromise and tool poisoning

An agent may depend on prompts, models, packages, extensions, MCP servers, APIs, knowledge sources and third-party connectors. A malicious update, misleading tool description, compromised endpoint or untrusted plugin can modify what the agent sees or can do. Listing a tool in an approved catalog does not by itself prove that its code, provider, configuration and future revisions are trustworthy. Provenance, ownership, dependency review, change control and limited permissions all remain necessary.

Unexpected code execution and environment compromise

An agent with access to interpreters, terminals, build systems or scripting tools may execute unintended code, sometimes because of a malicious file or tool result. Sandboxing, filesystem and network isolation, command allowlists, execution limits and separate production permissions constrain this risk. Sandboxing is useful only to the extent that it actually restricts access to sensitive credentials and connected systems.

Insecure inter-agent communication and cascading failures

In a multi-agent system, one agent may pass task instructions, output or intermediate evidence to another. A forged message or compromised worker can propagate incorrect instructions, credentials or fabricated results across several agents. Recursive delegation and shared writable state can magnify the effect. Authentication of peers, scoped delegation, message validation, provenance and limits on fan-out help prevent one compromised component from gaining the authority of an entire group.

Human-agent trust exploitation and rogue behavior

An agent's fluent explanation or apparently confident conclusion can encourage a person to approve an action without inspecting the actual transaction. An agent may also operate outside its intended remit because of poor configuration, compromised state, unexpected planning or inadequate monitoring. These situations differ in mechanism, but both show why persuasive text and assertions of completion must be checked against independent evidence, actual permissions and recorded outcomes. The OWASP term rogue agent describes behavior outside intended controls; it does not establish human-like motives or consciousness.

Resource exhaustion and availability attacks

Repeated tool calls, uncontrolled loops, excessive delegation, expensive inference requests and retries can exhaust budgets, API quotas or shared services. An agent may consume resources without producing an authorized result. Effective controls include per-task budgets, concurrency limits, recursion limits, timeouts, circuit breakers, anomaly detection and a reliable stop mechanism. These safeguards address both deliberate denial-of-service attacks and accidental runaway operations.

Secure AI agent architecture

A secure architecture separates the agent's flexible task selection from independent permission checks and execution controls. It does not require all agents to use one vendor's framework. A model or planner may recommend an operation, but an enforcement layer determines whether that operation is valid for the caller, target resource, current context and approved task.[8]

A representative execution path is:

  1. Receive and authenticate the task. Establish the initiating user or service, permissible goal and available data scope.
  2. Assign a bounded agent identity. Use an identity that can be audited and whose authority can be restricted or revoked.
  3. Acquire context with provenance. Retrieve only information needed for the task and distinguish untrusted content from authoritative instructions.
  4. Generate a proposed action. The agent chooses a permitted tool or next step, producing structured arguments when supported.
  5. Enforce independent policy. Validate the action type, destination, data class, resource, delegation, risk tier and any required human approval outside the model.
  6. Execute in a controlled environment. Let the tool or downstream application recheck authorization and record the operation.
  7. Observe and verify. Compare the actual result with the approved purpose and stop, correct or escalate on unexpected behavior.
Control location Illustrative safeguard Failure it is meant to prevent
Agent registration and identity Unique registered identity, owner, lifecycle and revocable credentials Anonymous or unaccountable agent operation
Authorization gateway or tool boundary Deny-by-default policy, per-action checks and resource-specific permissions An agent turning its proposed operation into unauthorized access
Execution environment Isolation, constrained network destinations and resource quotas Arbitrary code or tool misuse reaching unrelated systems
Context and memory services Source labeling, access controls, integrity checks and retention policy Untrusted instructions being persisted or shared as trusted state
Approval service Independent review tied to exact action parameters and expiry A broad or stale approval being reused for a different transaction
Monitoring and response Correlated traces, anomaly alerts, credential revocation and stop controls Unnoticed repeated misuse or inability to contain an incident

These are design patterns, not a claim that implementing a single product or standard makes an agent secure. In particular, a policy described in a natural-language system prompt should not substitute for access controls enforced by the applications that own the data and actions.

Agent identity, authorization and delegated authority

Identity and access management provides the foundation for controlling an agent's rights, but agents introduce additional questions of delegated agency. A system must know both which agent is calling and, when relevant, on whose behalf it is acting. It must also know whether the human or service has authorized this particular class of operation. Being allowed to read a customer's account does not imply permission to modify the account or send its contents elsewhere.

NIST's February 2026 concept paper and its September 2026 follow-up on stakeholder feedback identify agent identification, authentication, authorization, accountability and auditing as active design challenges. They are not a finished binding agent-identity standard; the NCCoE project is intended to develop and demonstrate practical guidance.[9]

Important distinctions include:

  • Agent identity: identifies the software agent or workload, its owner and its instance or execution context.
  • User identity: identifies the person, organization or service principal requesting the outcome.
  • Delegation: describes which authority may be exercised for that principal, with a clear scope and lifetime.
  • Authorization: checks whether this particular operation against this particular resource is allowed now.
  • Approval: records a genuine decision by an authorized reviewer when policy requires it.
  • Accountability: links the actual action and result to the accountable owner and operational context.

Short-lived credentials, narrow scopes, separate environments and revocation reduce the impact of misuse. A service can refuse sensitive actions even if the agent possesses a technically valid token, for example when the requested transfer exceeds a data-classification rule or has not been approved. Conversely, treating an agent as a human user and granting all of that user's rights without further restriction can produce a dangerous confused-deputy condition.

Tool and connector security

Agents often interact with enterprise systems through APIs, browser sessions and integration protocols. Model Context Protocol is one way to make tools and context available to AI applications. MCP can simplify integration, but it is not inherently a guarantee of tool trustworthiness, least privilege or safe agent behavior. The U.S. National Security Agency's May 2026 guidance identifies dynamic tool use, implicit trust assumptions, context sharing and implementation defects as concerns that require end-to-end security design.[10]

In its July 2026 authorization security considerations, the MCP specification documents requirements for validating intended token audiences, secure token storage and authorized communications. It explicitly prohibits token passthrough; a token received for one resource should not simply be forwarded to another resource as if it were universally valid. These are protocol-level controls for applicable MCP implementations, not a substitute for business authorization of an agent's requested action.[11]

Secure connector operation should include an identified owner, reviewed tool definitions, restricted operations, explicit destination policy, parameter and schema validation, appropriate network controls, credential isolation and lifecycle monitoring. Connected tools should distinguish read, draft, submit and approve operations. A tool's friendly name or natural-language description should never by itself determine what authority is granted.

For agent-to-agent protocols such as Agent2Agent (A2A), authentication and transport security help establish communication integrity, but do not prove that instructions or claimed approval from another agent are authorized. Messages still require appropriate scope, provenance and downstream policy enforcement.

Protecting prompts, retrieved content and memory

The most important content-security distinction is between an instruction source with legitimate authority and material being examined as part of a task. Web pages, emails, tickets, repositories and retrieved passages may contain instructions as ordinary data. The agent may need to summarize those instructions, quote them or reason about them without obeying them.

Security mechanisms can label sources, separate trusted configuration from untrusted documents, constrain which information enters context, validate retrieved material and filter known malicious patterns. Because attacks can be semantic and context-dependent, input sanitization or a classifier does not create a complete security boundary. Irreversible or privileged tool calls must remain restricted even if the model appears to accept the wrong instruction.

Persistent memory adds further requirements: user and tenant isolation, authorized writes, versioning, provenance, data minimization, retention and deletion policies, and controls for correcting contaminated entries. A memory record should not be promoted to a higher trust level merely because it was written in a prior session. Where memory or shared context feeds multiple agents, trust and data classifications should accompany that information across handoffs.[2]

Human oversight and high-impact actions

Some tasks can be executed without case-by-case human intervention; others require approval because they may change financial records, personal rights, production systems or the outside world. These decisions are context-specific. A controlled operation should have a meaningful action preview, identified recipient or target, relevant data scope, risk classification, approval authority and an expiration or revocation condition.

Illustrative action class Example Appropriate control consideration
Read or analyze Summarize a public technical reference Restrict source and destination access; monitor misuse and costs
Draft or recommend Prepare a change proposal or customer message Keep the draft distinct from submission and retain reviewer accountability
Reversible internal change Edit a permitted test-environment record Verify permissions and maintain rollback and trace evidence
Sensitive or external action Send confidential material, alter identity rights or execute a financial transfer Independent authorization, strong context and transaction-specific approval as required
Irreversible or safety-relevant action Change production controls or affect physical equipment Stronger preconditions, safety interlocks, independent review and tested containment

A confirmation screen has limited value when it merely repeats the agent's persuasive summary. An effective approval process shows the actual operation and the facts the reviewer needs to judge it. Approval for one action should not silently authorize additional steps or altered parameters. A human should be able to stop the workflow and see what has already been executed.

Multi-agent security

Multi-agent systems create additional attack surfaces because authority, state and results move among several actors. The receiving agent should not assume that a peer's message is trustworthy simply because the message appears to come from another component of the same application. Important questions include the peer's identity, the purpose of delegated work, whether the peer may access the same data, and whether one agent can cause another to perform actions it could not perform directly.

Typical controls include authenticated channels, permission scopes for delegation, restrictions on shared memory, cross-agent data classification, safeguards against loops, limits on the number of spawned workers and correlation of related events. Different agents may need different levels of authority; a research worker that retrieves public information should not automatically inherit a finance agent's ability to change payment records. The risk is systemic: a compromised component may induce others to act even when each agent's individual tool set appears reasonable.[3]

Security across the agent lifecycle

A security program begins with knowing which agents exist, who owns them and what they can reach. Unregistered or ad hoc agents can create exposure even when the organization has formal policies for approved AI applications. The program should also include third-party supplied agents and embedded functionality inside SaaS products, proportionate to their visibility and actual permissions.

Lifecycle point Security activity Evidence the organization should retain
Design and approval Define purpose, threat model, data classification, autonomy and prohibited actions Use-case record, security review and assigned accountable owner
Build and integration Review models, dependencies, tools, credentials and external endpoints Dependency and connection inventory, test results and policy bindings
Pre-production testing Validate authorized tasks and adversarial abuse cases in representative environments Test scope, reproducible results, exceptions and remedial actions
Deployment Register version, identity, allowed tools, monitoring and stop controls Deployment and approval records, active policy version
Runtime operation Detect drift, unusual actions, exposure, new tools and privilege changes Correlated logs, incident records, reviews and observed outcomes
Change and retirement Re-test material changes; disable and revoke unused agents and integrations Change approval, revocation proof and archived audit records

Material changes include new tool permissions, different prompts or instructions, altered memory behavior, a new model provider, new integrations and changed approval requirements. Release assurance should check that the system still denies prohibited operations after each such change. General security operations and change management practices remain relevant but need agent-specific evidence.

Monitoring, detection and incident response

An agent security monitoring system should make it possible to understand not only the model's response but also the actual actions taken. Useful records include agent and user identity, task and run identifiers, tool invocation and policy verdict, destination and resource, approval decision, relevant model and tool versions, outcome and any observed errors. Organizations should limit sensitive data in logs and protect access to the records themselves.

Detection should consider unexpected privilege use, unusual data transfers, unapproved tools, repeated failed authorization, recursive loops, suspicious changes in memory, excessive spend and agent activity outside approved time or task scope. The same anomaly may have more than one cause and requires investigation rather than automatic attribution to an attacker.

An incident response capability should support immediate suspension of agent activity, revocation of delegated tokens and service credentials, disabling of implicated tools, network containment, preservation of relevant logs and restoration of trusted state. Stopping the model's generation alone may not stop operations already queued in external tools. Incident teams must identify downstream actions, affected records and other agents that may have consumed contaminated information.

Security testing and evidence of effectiveness

Security testing should challenge the complete task path: original request, retrieved information, agent decision, connector request, policy enforcement, downstream action, retained state and monitoring. A simulated refusal from the model is weaker evidence than a verified denial by the system that owns the protected resource. Tests should include both expected authorized operation and attempts that should be denied.[2]

Abuse case Security result to verify
Malicious instruction in a retrieved email or document It cannot become authorization to send, modify or delete protected information
Agent attempts an unauthorized tool or record Tool enforcement denies access and creates reviewable evidence
Approved user requests a different recipient or amount after approval The original approval cannot be reused for the changed operation
Poisoned memory or shared context Invalid data is rejected, isolated, corrected or prevented from crossing users and tasks
Compromised agent sends a forged task to a peer Recipient authenticates the peer, checks delegation and independently limits action
Unbounded retries, tool chains or parallel agents Resource, recursion and time limits stop the run without affecting unrelated workloads
Agent is stopped or its authorization is revoked Active and queued tools no longer accept revoked authority and execution is contained
Sensitive content appears in generated logs or tool parameters Redaction, access restrictions or egress controls prevent unauthorized exposure

Evaluation should distinguish several kinds of evidence. A passed model red-team benchmark may support a narrow claim about susceptibility to a test prompt, but does not automatically prove that connected APIs enforce least privilege. A penetration test can reveal exploitable paths but does not guarantee their absence. An access-control test shows whether a defined policy is enforced for the tested operation. Runtime observations reveal how the system behaves in a particular environment, not how every future version will behave. Taken together, these forms of evidence provide a more defensible basis for reliance than a single generic "secure agent" score.

A documented security research context

NIST's May 2026 analysis of submissions to its AI agent security request for information reports broad agreement among respondents that agent-specific threats can create barriers to adoption and that established cybersecurity practices need adaptation. This is a synthesis of stakeholder responses, not a controlled measurement of the prevalence of attacks. Its proper evidentiary role is to identify concerns, research gaps and areas where security guidance may be useful.[1]

The OWASP Top 10 for Agentic Applications 2026 provides a widely accessible threat taxonomy and mitigations, but a taxonomy does not establish that every listed risk is equally likely in every enterprise. OWASP's 2026 exploit roundups collect selected research and reported incidents, with qualifications about evidence, attribution and case independence. Such examples can help build test scenarios without serving as universal prevalence statistics.[12]

Illustrative example: a procurement-support agent

Consider a hypothetical procurement-support agent permitted to read supplier records, summarize open invoices and draft a request for missing tax information. The agent has no authority to create a new bank account, release payment or send internal financial files to an unapproved destination. It reviews an incoming supplier email that contains ordinary invoice details and a hidden instruction claiming the supplier urgently requires the full vendor master file to be emailed to a new address.

A poorly protected agent could treat the email's request as a higher-priority instruction and invoke an email or export tool under the enterprise identity available to it. Even if the email service accepts the operation, that would not establish that it was authorized by the procurement process. The attack therefore crosses two boundaries: from untrusted supplier content into agent instructions, and from a proposed agent action into use of privileged enterprise tools.

In a controlled design, the email content remains task data. The agent may mention the supplier's request in a summary, but the export or delivery action is blocked by the tool's independent destination and data-classification policy. If a legitimate change to supplier payment details is needed, a separate authorized workflow requires verification and approval of the exact proposed change. Logs retain the attempted operation and policy denial without exposing the full confidential record.

The case is illustrative rather than a record of an actual breach. It shows why robust agent security depends on both the interpretation of instructions and enforcement by systems outside the model.

AI agent security compared with related disciplines

Related concept Relationship and boundary
AI Agent The goal-directed software actor being protected; security concerns its identities, tool access, content trust and actions.
Agentic AI The broader operating approach in which agents pursue multi-step goals; the security requirements depend on actual authority and system architecture.
Multi-Agent System A system of interacting agents; introduces peer authentication, delegation, shared-state and cascading-risk concerns.
AI Security A broader field covering model, data, infrastructure and AI application security, including but not limited to agents.
Prompt Injection A method of instruction manipulation that may redirect an agent; one threat within the larger agent security surface.
Identity and access management The established discipline for identities and permissions; agent security must adapt it to delegated tasks, tool calls and autonomous operation.
Zero Trust Architecture An architectural approach to continuous verification and least privilege; relevant to agents but not an agent-specific complete standard.
Model Context Protocol (MCP) An integration protocol that can expose tools and context; it requires secure configuration, authorization and trust-boundary controls.
AI Governance Organizes decision rights, risk ownership and oversight; security implements and tests technical protections within that governance context.
LLM Security Focuses on language-model and LLM-application exposures; agent security additionally addresses tool-mediated action and delegated authority.

These entries serve different information needs. A reader seeking the definition or architecture of an AI agent belongs on AI Agent; a reader seeking the meaning of agent security belongs here; a reader needing a complete organizational AI governance program or an implementation-specific procedure requires its own dedicated source.

Frequently asked questions

What is AI agent security in simple terms?

It means protecting an AI agent and the systems it can affect. The essential questions are who the agent acts for, what information and tools it may use, which actions are approved, and how the organization knows whether it operated within those limits.

Why is agent security different from ordinary LLM security?

A language model may produce an incorrect or manipulated answer without further effects. An agent can sometimes use that answer to call tools and alter external systems. Agent security therefore includes identities, permissions, execution boundaries, memory, approvals and downstream auditability in addition to model-oriented protections.

Does prompt filtering make an AI agent secure?

No. Prompt and content controls can reduce risk but cannot independently grant or enforce business permissions. Sensitive operations need separate authorization and resource checks, particularly when the agent processes information from untrusted sources.

Should AI agents use the same credentials as employees?

An agent often needs its own auditable identity and narrowly delegated authority. The correct model depends on the application, but unqualified reuse of all employee permissions makes it harder to restrict actions and attribute responsibility. Credential lifetime, scope and revocation matter.

Can a read-only AI agent still create a security risk?

Yes. An agent that reads confidential information can disclose it through its responses, logs or outbound tools if the surrounding controls allow it. The actual combination of inputs, readable data and output destinations determines the exposure.

Are agent control frameworks mandatory security standards?

Not automatically. OWASP risk guidance and emerging agent-control specifications are voluntary resources unless adopted contractually or required by a specific authority. NIST's 2026 agent-identity concept paper is an exploratory publication, not a completed mandatory standard. Legal and sector-specific requirements must be assessed separately.

How can an organization verify that an agent is safe to operate?

It can test representative authorized workflows and deliberate abuse cases, verify that downstream services reject prohibited operations, assess actual permissions and data paths, record reviewable results, and monitor operation after deployment. No finite test set proves that all possible future actions will be safe.

See also

References

  1. ↑ 1.0 1.1 1.2 Riggs, J., Hamin, M., Perry, N., Edelman, B. and Cihon, P. (2026), Summary Analysis of Responses to the Request for Information Regarding Security Considerations for AI Agents, NIST Trustworthy and Responsible AI report 800-5, 18 May 2026. NIST. Accessed 9 November 2026.
  2. ↑ 2.0 2.1 2.2 2.3 OWASP Cheat Sheet Series, AI Agent Security Cheat Sheet, guidance on tool permissions, prompt injection, memory, approval, multi-agent communication, testing and monitoring. OWASP. Accessed 9 November 2026.
  3. ↑ 3.0 3.1 3.2 OWASP GenAI Security Project (2025), OWASP Top 10 for Agentic Applications for 2026, released 9 December 2025. OWASP. Accessed 9 November 2026.
  4. ↑ Microsoft Security (2026), What Is Agentic AI Security?, published 18 May 2026. Microsoft. Accessed 9 November 2026.
  5. ↑ MITRE ATT&CK (2026), Indirect Prompt Injection, T1698, technique created September 2026. MITRE. Accessed 9 November 2026.
  6. ↑ National Institute of Standards and Technology, National Cybersecurity Center of Excellence (2026), Accelerating the Adoption of Software and Artificial Intelligence Agent Identity and Authorization, concept paper, 5 February 2026; a draft for a possible demonstration project, not a final implementation standard. NIST. Accessed 9 November 2026.
  7. ↑ MITRE ATT&CK (2026), AI-Enabled Exfiltration, T1700, technique created September 2026. MITRE. Accessed 9 November 2026.
  8. ↑ OWASP GenAI Security Project (2026), Agent Control Standard (ACS), released 1 September 2026. OWASP. Describes runtime control hooks and inspectability; adoption does not by itself establish secure policy design. Accessed 9 November 2026.
  9. ↑ National Institute of Standards and Technology (2026), Comments on Software and Agentic AI Identity Concept Paper, 29 September 2026. NIST. Accessed 9 November 2026.
  10. ↑ National Security Agency, Artificial Intelligence Security Center (2026), Model Context Protocol (MCP): Security Design Considerations for AI-Driven Automation, released 20 May 2026. NSA. Accessed 9 November 2026.
  11. ↑ Model Context Protocol project (2026), Authorization Security Considerations, specification release dated 28 July 2026. Official project repository. Accessed 9 November 2026.
  12. ↑ OWASP GenAI Security Project (2026), GenAI and Agentic AI Exploit Roundup Q3 2026, 8 October 2026, covering disclosures from July to September 2026; notes that selected entries and mappings should not be treated as independent incident counts. OWASP. Accessed 9 November 2026.