Research
Adversarially Attacking Symbolic Vocabulary Vulnerabilities in LLM Planners
The paper introduces Symbolic Swapper, an LLM-based adversarial attack model that automatically generates obfuscated planning domains with non-standard symbolic vocabularies. It evaluates whether strong reasoning LLMs retain robust planning when commonsense cues in action, predicate, and object names are removed. The authors report that these attacks can reduce planning performance of base models and robust planning frameworks by over 70%, and they analyze how domain understanding and planning ability diverge.
Large language modelsAutomated planningAdversarial robustness