Back to AI News
arxiv

LatentTriad: Pre-Action Risk Representations for Malicious Agent Skill Detection

LatentTriad is a new method that detects malicious skills in LLM agents without executing them, using hidden states from a single prefill pass. It combines contextual boundary features, group-adjusted operation directions, and departures from benign state relationships to achieve 99.0-99.2% pooled F1 across 5,830 skill packages. The method is execution-free, producing no output tokens and invoking no tools, with a compact implementation running in 259-284 ms median.

AI Brief

This paper presents a concrete, recent AI safety technique with strong empirical results and practical efficiency, valuable for developers and researchers working on agent security.

arXiv:2611.05088v1 Announce Type: new Abstract: Large language model agents are increasingly extended with reusable skills, but untrusted skill content can induce operations outside the user's task. Detecting this contextual risk requires more than suspicious-pattern matching, while dynamic analysis incurs the cost of skill execution. We find that hidden states formed during prefill contain readable information about task-operation consistency, including across held-out expression forms in controlled evaluations. Matched Operation-state interventions also affect later Boundary states and shift fixed risk readouts toward the donor label. Based on these findings, we introduce LatentTriad, which combines contextual Boundary features, group-adjusted Operation directions, and departures from benign state relationships. All branches share one prefill: detection generates no output tokens, invokes no tools, and executes no skill code. Across 5,830 skill packages from five sources and seven backbones, LatentTriad achieves 99.0-99.2% pooled F1 and 93.0-94.6% source-macro F1. A separately measured compact implementation completes prefill and detection in a median of 259-284 ms. These results connect pre-action risk readability and functional influence to execution-free skill screening.
Be the first to rate this article.

Comments & Questions (0)

Captcha
Please be respectful — let's keep the conversation friendly.

No comments yet

Be the first to comment!