Shibboleth Traps Fingerprint LLM Models and Harnesses Behind Agentic Attacks
This arXiv paper studies fingerprinting agentic cyberattacks by inferring the attacker's LLM version and harness from telemetry. The authors introduce "shibboleth traps" — modular honeypot services that condition access to resources on informative interactions, eliciting model declarations and characteristic writing without needing a successful prompt injection. For harness fingerprinting, they use indirect probes that reveal secret masking in tool output, command time limits and tool-call scheduling from effects visible in later requests. Combined declarative and behavioral inference distinguished among 15 candidate models at an average 90% top-1 accuracy, and fixed probe rules identified the correct harness among four with 92% accuracy; agents instructed to conceal identity still left behavioral evidence.
It offers defenders a concrete attribution technique for identifying which models and agent harnesses drive agentic attacks, even when agents are told to hide their identity.
Comments & Questions (0)
No comments yet
Be the first to comment!