Circe: Training-Free LLM Self-Evaluation via Component Interaction Consistency
Circe is a training-free method for judging whether an LLM response is correct without reference answers or repeated sampling. Its internal signals measure directional alignment between earlier attention updates and later attention-induced FFN output changes (component interaction consistency), plus representation geometry along layerwise hidden-state trajectories. A bounded likelihood confidence score from mean negative log-likelihood of generated tokens serves as the external signal, and the three are fused into one correctness score. The authors report that across five LLMs and six benchmarks in four domains it separates correct from incorrect responses better than existing baselines and generalizes to multilingual, multimodal and open-world settings.