Parameter-Efficient Conciseness Adaptation: Differentiable Length Control for Concise Clinical Reasoning in Smaller Language Models
The paper introduces PECA, a method that adds a differentiable conciseness term to QLoRA supervised fine-tuning for smaller language models. Instead of relying on preference data, reward models, or proprietary teachers,...