Research Editor selected
TCSExam: A New Benchmark for LLMs in Theoretical Computer Science
TCSExam is a unified benchmark covering theorem proving, solver engineering, constructions, and open conjectures in theoretical computer science. It includes 100 expert-reviewed tasks (Full) and a 20-task Lite version, with evaluations of frontier LLMs like GPT-6 Astra and Opus 5.5. Results show strong alignment between Full and Lite rankings, supporting Lite as a compact discriminative benchmark. The framework provides reproducible evaluation tools and Docker build recipes.
Why it matters: Introduces a rigorous, extensible benchmark for measuring LLM progress on core TCS research, with concrete results from multiple frontier models.
TCSExamLLM evaluationtheoretical computer science