Live intelligence

Latest AI updates

2 updates
Research

Neuron-Level Specialization in Mixture-of-Experts Language Models

This arXiv paper introduces Routing-Aware Magnitude Profiling (RAMP) to study domain-specialized computation at the neuron level in Mixture-of-Experts models. It reports domain-specialized neuron sets with 58-74% overlap across same-domain samples versus 15-24% across different domains. The analysis traces neuron importance through pre-training and post-training across three open MoE families, finding continued reorganization between pre-training checkpoints but largely preserved rankings after post-training. It also presents RAMP-based Pruning (RAMPr), which preserves 91-98% of full performance at 75% neuron retention across six models and, at 50% retention, reduces resident GPU memory by 36-43% and improves batched prefill throughput by 17-39%.

Mixture-of-ExpertsModel PruningLanguage Models
Research Editor selected

Addition by Subtraction: Mitigating Fragile Safety Alignment in LLMs

This paper introduces Addition by Subtraction, a finetuning method that removes safety-critical neurons and uses preference optimization to redistribute safety behavior across the model. The resulting models are significantly more robust to pruning-based attacks, refusal-direction ablation, and various black-box jailbreaks, with attack success rates reduced by up to 90% across four models. The approach also improves truthfulness while largely preserving general capabilities.

Why it matters: Provides a concrete, novel method to strengthen LLM safety alignment against sparse-component vulnerabilities, with broad empirical validation.

LLM safetyadversarial robustnessmodel pruning