Live GPU Hidden State Acquisition Enables Request-Level Attribution in LLMs
Researchers present a method to extract per-layer residual-stream activations from a live GPU process using a non-modifying debugger, without prior model knowledge. The approach is validated on 33 open-source decoder-onl...