SpecOPD: Branch-Parallel On-Policy Distillation for Speculative Decoding
SpecOPD introduces a branch-parallel framework for on-policy distillation in speculative decoding, enabling draft models to be trained without sequential draft-and-verify rollouts. By packing independent branches into pr...