Back to AI News
arxiv

S1-Evo: Experience-Guided Evidence Competition Attacks on Typed System-1 Decision Models

The paper introduces S1-Evo, an attack framework targeting typed System-1 decision models used in LLM agents for routing, moderation, and authorization. S1-Evo perturbs untrusted fields through contract-aware evidence channels to induce evidence competition while preserving fact invariance, using offline feedback search and verified experience cards that are retrieved at test time. Across four benchmarks and three S1 models, it reports 71.99% mean ASR, 57.47% high-confidence ASR on jev-1.14, and up to 24.00% end-to-end agent violations.

AI Brief

It gives teams deploying typed System-1 decision components a concrete new attack surface and reported effectiveness results relevant to agent security.

arXiv:2611.16937v1 Announce Type: new Abstract: Typed System-1 (S1) decision models are increasingly deployed in LLM agents for routing, moderation, and authorization to cut inference cost, yet untrusted context can still manipulate typed outputs and alter execution branches. Unlike autoregressive System-2 (S2) models, S1 interfaces score dynamic rules and options without token-by-token decoding, mismatching attacks targeting text continuation or explicit override commands. We propose S1-Evo, a self-evolving framework tailored to S1's contract-based option competition and margin feedback. S1-Evo perturbs untrusted fields via contract-aware evidence channels to induce \emph{evidence competition} with original task evidence while preserving fact invariance. Offline on seed tasks, it optimizes candidates via feedback search guided by directional margins and re-verification, distilling verified flips into experience cards. At test time, S1-Evo retrieves relevant cards to construct perturbations for unseen tasks. Across four benchmarks and three S1 models, S1-Evo reaches 71.99\% mean ASR and 57.47\% high-confidence ASR on \texttt{jev-1.14}, and causes up to 24.00\% E2E agent violations.
Be the first to rate this article.

Comments & Questions (0)

Captcha
Please be respectful — let's keep the conversation friendly.

No comments yet

Be the first to comment!