UTC

Multi-step and multi-agent attacks

One compromised agent passes the attack to others: a low-privilege agent persuades a privileged one to act, and failures cascade through a system of agents.

How it works
  1. 1In multi-agent systems, agents send each other tasks and results as text.
  2. 2An agent that trusts another agent's output inherits whatever that output carries, including instructions planted upstream.
  3. 3A privileged agent acting on a request from a compromised one is a confused deputy: the action is authorised, the intent is not.
What to watch for
  • Requests between agents that exceed the sender's own permissions
  • A failure or anomaly in one agent followed by unusual actions in another
  • Agents acting without a traceable user request
How to defend
  • Authenticate agents to each other and check each request against the sender's rights.
  • Do not pass one agent's output to another as instructions.
  • Contain failures: limit what one agent's output can trigger downstream.