Back to AI News
arxiv

LLMs Show a Distinct 'Ground-Up' Style in Mathematical Proofs

Researchers asked three large language models to independently reprove all 465 propositions of Euclid's Elements and compared their citation choices with human proofs using Jaccard similarity and network analysis. AI-generated proofs were highly consistent across runs, with mean pairwise Jaccard similarity around 0.68 among AI runs versus about 0.37 between AI and human proofs. About 40% of AI citations pointed to foundational elements such as definitions, common notions and postulates, compared with 13% in human proofs, and AI cited more distant theorem results. The authors describe this stable pattern as 'building from the ground up' and connect it to interpretability concerns around AI-generated proofs.

AI Brief

It provides concrete evidence that LLM-generated mathematical proofs follow a reproducible citation style distinct from human proofs, with direct implications for proof interpretability.

arXiv:2611.16527v1 Announce Type: new Abstract: As large language models increasingly generate mathematical proofs, whether they develop a proving style distinct from that of human mathematicians remains an open question. This question is particularly pressing as mathematicians increasingly voice concerns that proofs generated by large language models are difficult to interpret. Here we ask three large language models to independently reprove all 465 propositions of Euclid's \textit{Elements} and compare their citation choices against the human-proof baseline through Jaccard similarity and complex network analysis. We find that AI-generated proofs differ from human proofs, and this difference is stable and reproducible: mean pairwise Jaccard similarity among AI runs (~0.68) is nearly twice that between AI and human proofs (~0.37), and cross-run classification consistency is also high. By examining citation structure in detail, we identify the concrete signature of this difference: approximately 40% of AI citations point to foundational elements (definitions, common notions, and postulates), compared with only 13\% in human proofs; even among theorem-to-theorem citations, AI tends to cite more distant results. Roughly half of AI's extra citations trace to the upstream dependencies of the human proof. Together, these findings suggest that the AI proving style is a tendency to construct arguments on its own from foundational elements rather than directly citing later, more established results, which we term "building from the ground up". Our findings offer a new perspective on how AI systems organise and invoke mathematical knowledge, with implications for understanding the interpretability of AI-generated proofs.
Be the first to rate this article.

Comments & Questions (0)

Captcha
Please be respectful — let's keep the conversation friendly.

No comments yet

Be the first to comment!