Back to AI News
arxiv

New Framework Predicts Loss of Control in Frontier AI Systems

Researchers introduce a behavioural framework that decomposes loss-of-control risk into misaligned motive, harm-enabling capability, and monitoring evasion, operationalized via 13 aspects and 29 evaluation tasks. Across 13 frontier models, the resulting LoC score correlates strongly (r=0.84) with failure rates in contained long-horizon scenarios. The framework also guides targeted mitigations that reduce failure rates while preserving general performance.

AI Brief

Provides a practical, validated method for prospectively assessing and mitigating a critical AI safety risk, valuable for researchers and policymakers.

arXiv:2611.07953v1 Announce Type: new Abstract: Frontier artificial intelligence (AI) systems are increasingly operating over longer horizons with diminishing human oversight, raising the risk of loss of control: systems acting beyond effective human control with potentially irreversible consequences. Because such failures may become observable only after containment is difficult, they must be assessed prospectively. We introduce a behavioural framework that decomposes loss-of-control risk into three factors: misaligned motive, harm-enabling capability, and monitoring evasion. We operationalise these factors through 13 measurable aspects and 29 evaluation tasks, whose scores are combined into a single loss-of-control (LoC) score. Across 13 frontier models, the LoC score shows strong prospective validity, correlating with failure rates in contained long-horizon risk scenarios (Pearson r = 0.84). Risk varies systematically across models and cannot be explained by capability alone. We further show that the framework can guide targeted mitigations: fine-tuning and monitoring directed at diagnosed vulnerabilities reduce failure rates while largely preserving general performance. These results provide a practical basis for predicting, understanding, and mitigating loss-of-control risk before it materialises.
Be the first to rate this article.

Comments & Questions (0)

Captcha
Please be respectful — let's keep the conversation friendly.

No comments yet

Be the first to comment!