OmniParseBench: an open benchmark for document parsers, rebuilt and audited
This tutorial walks through Datalab's OmniParseBench, an open document-parsing benchmark comprising 16,288 pass/fail tests across 2,937 pages covering scanned forms, handwriting, arXiv math and dense tables. Using the released verdicts for 27 parsers, the author recomputes the leaderboard, inspects how the scorer's unit tests reach a verdict, and tests ranking certainty and per-document-type slices. It reports that the top two parsers are statistically tied, that the leader changes across most s