Live intelligence

Latest AI updates

1 updates
Research

When Feedback Becomes a Backdoor: Tracing Backdoor Skill Formation in Text-Space Skill Optimization

This arXiv paper studies reference-feedback poisoning in SkillOpt, where poisoned reference answers can induce trigger-conditioned rules in reusable text Skills without attacker access to the model, optimizer, or Skill file. In SearchQA, the natural attack retained an exact rule across all three seeds, with final Skills emitting the payload on 200/200 triggered questions and 0/200 clean questions; removing the rule in seed 42 eliminated activation, and clean accuracy was similar to benign SkillOpt (169/200 versus 171/200). In SpreadsheetBench, no natural run retained an exact rule across three seeds, with diagnostics identifying literal abstraction by the Analyst and edit-budget ranking as successive bottlenecks. The findings show that poisoned references can create persistent backdoors, but exposure alone does not guarantee that an induced rule is formed, selected, and retained.

AI agent securitybackdoor poisoningtext-space skill optimization