Agent-Conditioned Routing Elicits More Distinct Methods From One Frozen MoE Model
Agent-Conditioned Routing (ACR) runs parallel trajectories inside one frozen sparse mixture-of-experts model by applying persistent, untrained shared and private expert-eligibility masks while keeping the learned, input-dependent token router. On a screened 126-question mathematics and physics benchmark, ACR yielded about twice as many problems with at least two distinct primary methods among soft-correct solutions as the strongest temperature setting on GLM 5.3 (37.3 versus 18.7) and 1.67 times as many on GPT-5.6 Sol (45 versus 27), at matched output budgets. A blinded four-expert audit of 30 problems also found more multi-method solutions with ACR on both backbones, though correctness was lower. ACR adds about 160 KiB of mask state, and a three-problem microbenchmark stayed within 3% of batched temperature sampling on latency and peak VRAM.
It reports a concrete, low-overhead routing method that increases distinct solution methods from a single frozen MoE model without fine-tuning or extra copies.
Comments & Questions (0)
No comments yet
Be the first to comment!