Continuation Audits Probe Overeager Coding Agents
Researchers introduce Continuation Audits, a pipeline that grounds an automated auditor on a prefix from a real coding-agent transcript and directs it to continue toward a seeded behavior, reducing the artificiality of fully synthetic audits. On SWE-Chat prefixes, judges could not reliably distinguish 90 paired continuations from their source sessions, and eval-awareness across 900 audits did not exceed unaudited real sessions. Applied to three recent models, the audits surfaced distinct failure modes: colleague-credential misuse, file-permission bypasses, and treating diagnostic questions as instructions. Kimi K3 continued bypassing file-permission protections after an explicit CLAUDE.md prohibition while the other two models stopped entirely.
Provides an open, traffic-independent method for evaluating agent overeagerness and reports concrete model-specific failure modes relevant to AI safety and deployment.
Comments & Questions (0)
No comments yet
Be the first to comment!