Research
Live GPU Hidden State Acquisition Enables Request-Level Attribution in LLMs
Researchers present a method to extract per-layer residual-stream activations from a live GPU process using a non-modifying debugger, without prior model knowledge. The approach is validated on 33 open-source decoder-only models, achieving byte-exact recoverycars. Linear probes on recovered states distinguish refusal from compliance with AUROC 0.88, enabling forensic analysis of deployed LLM behavior.
AI forensicsLLM interpretabilityGPU memory analysis