Context Compression Weakens Refusal Alignment in LLMs
A new study shows that encoder-based context compression systematically weakens refusal behavior in instruction-tuned language models, even when reconstruction fidelity is high. The effect persists across model families and compression architectures, and is traced to attenuation of the decoder's refusal direction. The authors propose Memory Steering, a lightweight inference-time intervention that restores refusal rates without retraining.