Addition by Subtraction: Mitigating Fragile Safety Alignment in LLMs
This paper introduces Addition by Subtraction, a finetuning method that removes safety-critical neurons and uses preference optimization to redistribute safety behavior across the model. The resulting models are signific...