Why Agentic Theorem Prover Works: A Statistical Provability Theory of Mathematical Reasoning Models
Sho Sonoda, Shunta Akiyama, Yuya Uezato
摘要
Agentic theorem provers combine a reasoning model, retrieval, search, and a proof assistant verifier, yet it remains unclear which components actually improve finite-budget proof success and why they help on real mathematical workloads. We study this question through statistical provability : the probability of reaching a verified proof within a budget on a specified stream of theorem instances. We model formal proof search as a finite-horizon reachability MDP with deterministic verifier dynamics, and show that under a faithful state abstraction the optimal success probability coincides with ordinary syntactic provability. We then analyze a simple but practically important pipeline: depth-wise offline action-value regression followed by greedy test-time proving. Our main theorem bounds the provability gap between the learned prover and the optimal prover by an occupancy-weighted sum of uniform action-value errors; in the common uniform-error reading, the leading complexity multiplier is the learned prover's average truncated proof length. The error decomposes into approximation error, geometric coverage of the training distribution, and Monte Carlo label noise, and improves to a fast rate under an action-gap margin condition. The result gives a component-sensitive account of why verifier feedback, retrieval, representation geometry, and proof-shortening mechanisms help on biased theorem workloads, without contradicting classical worst-case hardness.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper9
- Large Language Models are Zero-Shot ReasonersTakeshi Kojima, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo 等NeurIPS 2022 · 被引用 8,168 次
- Towards Revealing the Mystery behind Chain of Thought: A Theoretical PerspectiveGuhao Feng, Bohang Zhang, Yuntian Gu, Haotian Ye 等NeurIPS 2023 · 被引用 470 次
- miniF2F: a cross-system benchmark for formal Olympiad-level mathematicsKunhao Zheng, Jesse Michael Han, Stanislas PoluICLR 2022 · 被引用 342 次
- Training Chain-of-Thought via Latent-Variable InferenceMatthew Douglas Hoffman, Du Phan, David Dohan, Sholto Douglas 等NeurIPS 2023 · 被引用 74 次
- Draft, Sketch, and Prove: Guiding Formal Theorem Provers with Informal ProofsAlbert Qiaochu Jiang, Sean Welleck, Jin Peng Zhou, Timothée Lacroix 等ICLR 2023 · 被引用 25 次
相关 Paper
- 3D-Prover: Diversity Driven Theorem Proving With Determinantal Point ProcessesSean Lamont, Christian Walder, Amir Dezfouli, Paul Montague 等NeurIPS 2025 · 被引用 6 次
- A Minimal Agent for Automated Theorem ProvingBorja Requena, Austin Letson, Krystian Nowakowski, Izan Beltran Ferreiro 等ICML 2026 · 被引用 9 次
- Process-Verified Reinforcement Learning for Theorem Proving via LeanMinsu Kim, Se-Young YunICLR 2026 · 被引用 16 次
- DT-Solver: Automated Theorem Proving with Dynamic-Tree Sampling Guided by Proof-level Value FunctionHaiming Wang, Ye Yuan, Zhengying Liu, Jianhao Shen 等ACL 2023 · 被引用 5 次
- Compile to Compress: Boosting Formal Theorem Provers by Compiler OutputsGuchan Li, Rui Tian, Hongning WangICML 2026
