arXiv:2611.02775v1 Announce Type: cross
Abstract: Financial document recognition is commonly evaluated using character and word error rates, which do not adequately represent the consequences of errors in financial workflows. This paper formalizes financial document recognition as a risk-constrained evidence-recovery problem. It defines typed, evidence-linked financial facts and a multi-layer quality model spanning text, layout, tables, fields, semantic relations, calibration, robustness, and operational performance. It introduces non-compensatory acceptance gates based on upper confidence bounds for critical-field errors, and formulates selective automation as a constrained risk-coverage problem with review-capacity limits. The paper also specifies annotation requirements, leakage-resistant benchmark splits, statistical estimands, and a reproducibility card. Formal propositions establish why aggregate scores cannot certify critical-field reliability and why zero observed errors do not imply zero risk. A synthetic example illustrates the decision rule. The work is theoretical; no empirical benchmark or model performance claim is presented.
arxiv
Risk-Constrained Evaluation of Financial Document Recognition: A Formal Framework for Evidence, Critical Errors, and Selective Automation
This paper formalizes financial document recognition as a risk-constrained evidence-recovery problem, moving beyond standard character and word error rates. It introduces typed financial facts, a multi-layer quality model, and non-compensatory acceptance gates based on upper confidence bounds for critical-field errors. Selective automation is formulated as a constrained risk-coverage problem with review-capacity limits. The work is theoretical, providing formal propositions and annotation requirements without empirical benchmarks.
Provides a rigorous theoretical foundation for risk-aware evaluation in financial document AI, addressing critical gaps in current metrics.
Comments & Questions (0)
No comments yet
Be the first to comment!