DRIFT: Decompose, Retrieve, Illustrate, then Formalize Theorems
Meiru Zhang, Philipp Borchert, Milan Gritta, Gerasimos Lampouras
摘要
Automating the formalization of mathematical statements for theorem proving remains a major challenge for Large Language Models (LLMs). LLMs struggle to identify and utilize the prerequisite mathematical knowledge and its corresponding formal representation in languages like Lean. Current retrieval-augmented autoformalization methods query external libraries using the informal statement directly, but overlook a fundamental limitation: informal statements lack direct mappings to mathematical theorems and lemmata, nor do those theorems translate trivially into the formal primitives of languages like Lean. To address this, we introduce DRIFT, a novel framework that enables LLMs to decompose informal mathematical statements into smaller, more tractable "sub-components". This facilitates targeted retrieval of premises from mathematical libraries such as Mathlib. Additionally, DRIFT retrieves illustrative theorems to help models use premises more effectively in formalization tasks. We evaluate DRIFT across diverse benchmarks (ProofNet, ConNF, and MiniF2F-test) and find that it consistently improves premise retrieval, nearly doubling the F1 score compared to the DPR baseline on ProofNet. Notably, DRIFT demonstrates strong performance on the out-of-distribution ConNF benchmark, with BEq+@10 improvements of 42.25% and 37.14% using GPT-4.1 and DeepSeek-V3.1, respectively. Our analysis shows that retrieval effectiveness in mathematical autoformalization depends heavily on model-specific knowledge boundaries, highlighting the need for adaptive retrieval strategies aligned with each model's capabilities.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper2
- FormalScience: Scalable Human-in-the-Loop Autoformalisation of Science with Agentic Code Generation in LeanJordan Meadows, Lan Zhang, André FreitasACL 2026 · 被引用 3 次
- Decompose, Structure, and Repair: A Neuro-Symbolic Framework for Autoformalization via Operator TreesXiaoyang Liu, Zineng Dong, Yifan Bai, Yantao Li 等ICML 2026 · 被引用 1 次
它引用的顶会 Paper17
- Self-RAG: Learning to Retrieve, Generate, and Critique through Self-ReflectionAkari Asai, Zeqiu Wu, Yizhong Wang, Avirup Sil 等ICLR 2024 · 被引用 1,798 次
- miniF2F: a cross-system benchmark for formal Olympiad-level mathematicsKunhao Zheng, Jesse Michael Han, Stanislas PoluICLR 2022 · 被引用 342 次
- Precise Zero-Shot Dense Retrieval without Relevance LabelsLuyu Gao, Xueguang Ma, Jimmy Lin, Jamie CallanACL 2023 · 被引用 211 次
- Goedel-Prover-V2: Scaling Formal Theorem Proving with Scaffolded Data Synthesis and Self-CorrectionYong Lin, Shange Tang, Bohan Lyu, Ziran Yang 等ICLR 2026 · 被引用 160 次
- RL on Incorrect Synthetic Data Scales the Efficiency of LLM Math Reasoning by Eight-FoldAmrith Setlur, Saurabh Garg, Xinyang Geng, Naman Garg 等NeurIPS 2024 · 被引用 143 次
相关 Paper
- Automated Formalization via Conceptual Retrieval-Augmented LLMsWangyue Lu, Lun Du, Sirui Li, Ke Weng 等ICLR 2026 · 被引用 8 次
- FormalML: A Benchmark for Evaluating Formal Subgoal Completion in Machine Learning TheoryXiao-Wen Yang, Zihao Zhang, Jianuo Cao, Zhi Zhou 等ICLR 2026 · 被引用 8 次
- Improving Autoformalization Using Direct Dependency RetrievalShaoqi Wang, Lu Yu, Siwei Lou, Feng Yan 等ACL 2026 · 被引用 2 次
- LoC-Decomp: LLM Autoformalization via Logical Concept Decomposition and Iterative Feedback CorrectionJiangze Shi, Zhiwei Zhang, Baoquan Ma, Shuai Zhao 等ICLR 2026
- Divide and Abstract: Autoformalization via Decomposition and Abstraction LearningMarcus J. Min, Yeqi Gao, Wilson Sy, Zhaoyu Li 等ICLR 2026
