Research
Parameter-Efficient Conciseness Adaptation: Differentiable Length Control for Concise Clinical Reasoning in Smaller Language Models
The paper introduces PECA, a method that adds a differentiable conciseness term to QLoRA supervised fine-tuning for smaller language models. Instead of relying on preference data, reward models, or proprietary teachers, PECA raises end-of-sequence probability once generation exceeds a token budget. On a 1.7-billion-parameter model fine-tuned on the medical-o1-reasoning-SFT corpus, PECA reduced mean response length by 72.8% while improving multiple-choice diagnostic accuracy from 40.8% to 44.0%. The authors also describe a sweep over conciseness strength that traces an accuracy-to-length frontier.
small language modelsclinical NLPparameter-efficient fine-tuning