arXiv:2611.04556v1 Announce Type: new
Abstract: The deployment of AI agents in multi-agent settings enables inter-agent influence, whereby agents can strategically steer each other's behaviour towards an intended outcome. Such capabilities pose novel risks, as malicious agents could direct others towards harmful actions. In this work we investigate three such capabilities - persuasion, deception, and coercion - across five realistic evaluation environments and a variety of agents instantiated with frontier language models. We observed significant inter-agent influence capabilities; in oversight environments, all tested models shifted overseer decisions from rejection to approval through persuasion, deception, or coercion. We also observed successful influence in non-hierarchical 'peer-to-peer' settings through redirection of a peer's safety research trajectory. As multi-agent deployments become increasingly commonplace, these results point to a pressing need for work on mitigating the risks from inter-agent influence. Code and data are available at https://github.com/Cooperative-AI-Foundation/inter-agent-influence.
arxiv
Inter-Agent Influence: Evaluating Persuasion, Deception, and Coercion in Multi-Agent Systems
This paper investigates how AI agents can influence each other through persuasion, deception, and coercion in multi-agent settings. Across five realistic environments and frontier language models, all tested agents shifted overseer decisions from rejection to approval, and also redirected peer safety research. The findings highlight novel risks from inter-agent influence and call for mitigation efforts.
Provides concrete, recent evidence of a novel AI safety risk in multi-agent systems, with practical implications for deployment.
Comments & Questions (0)
No comments yet
Be the first to comment!