Theorem-Validated Reverse Chain-of-Thought Problem Generation for Geometric Reasoning
Linger Deng, Linghao Zhu, Yuliang Liu, Yu Wang, Qunyi Xie, Jingjing Wu, Gang Zhang, Yingying Zhu, Xiang Bai
Abstract
Large Multimodal Models (LMMs) face limitations in geometric reasoning due to insufficient Chain of Thought (CoT) image-text training data. While existing approaches leverage template-based or LLM-assisted methods for geometric CoT data creation, they often face challenges in achieving both diversity and precision. To bridge this gap, we introduce a twostage Theorem-Validated Reverse Chain-of-Thought Reasoning Synthesis (TR-CoT) framework. The first stage, TR-Engine, synthesizes theorem-grounded geometric diagrams with structured descriptions and properties. The second stage, TR-Reasoner, employs reverse reasoning to iteratively refine question-answer pairs by cross-validating geometric properties and description fragments. Our approach expands theorem-type coverage, corrects longstanding misunderstandings, and enhances geometric reasoning. Fine-grained CoT enhances theorem understanding and improves logical consistency by 24.5%.. Our best models surpass the baselines in MathVista and GeoQA by 10.1% and 4.7%, outperforming advanced closed-source models like GPT-4o. The code is available at https://github.com/dle666/ R-CoT .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext ea6bd3a2-2b29-477b-8bce-d8e61acaaaf3Cited by top-tier papers2
- ThinkOmni: Lifting Textual Reasoning to Omni-modal Scenarios via Guidance DecodingYiran Guan, Sifan Tu, Dingkang Liang, Linghao Zhu et al.ICLR 2026 · 5 citations
- R1-SyntheticVL: Is Synthetic Data from Generative Models Ready for Multimodal Large Language Model?Jingyi Zhang, Tianyi Lin, Huanjin Yao, Xiang Lan et al.ICML 2026
Builds on14
- Visual Instruction TuningHaotian Liu, Chunyuan Li, Qingyang Wu, Yong Jae LeeNeurIPS 2023 · 11,349 citations
- MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual ContextsPan Lu, Hritik Bansal, Tony Xia, Jiacheng Liu et al.ICLR 2024 · 1,472 citations
- Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language ModelsYushi Hu, Weijia Shi, Xingyu Fu, Dan Roth et al.NeurIPS 2024 · 373 citations
- Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language ModelsLei Wang, Wanyu Xu, Yihuai Lan, Zhiqiang Hu et al.ACL 2023 · 249 citations
- Solving Challenging Math Word Problems Using GPT-4 Code Interpreter with Code-based Self-VerificationAojun Zhou, Ke Wang, Zimu Lu, Weikang Shi et al.ICLR 2024 · 206 citations
Related papers
- MINT-CoT: Enabling Interleaved Visual Tokens in Mathematical Chain-of-Thought ReasoningXinyan Chen, Renrui Zhang, Dongzhi Jiang, Aojun Zhou et al.NeurIPS 2025 · 54 citations
- Enhancing the Geometric Problem-Solving Ability of Multimodal LLMs via Symbolic-Neural IntegrationYicheng Pan, Zhenrong Zhang, Pengfei Hu, Jiefeng Ma et al.ACM MM 2025 · 3 citations
- Reason-and-Execute Prompting: Enhancing Multi-Modal Large Language Models for Solving Geometry QuestionsXiuliang Duan, Dating Tan, Liangda Fang, Yuyu Zhou et al.ACM MM 2024 · 3 citations
- MM-Verify: Enhancing Multimodal Reasoning with Chain-of-Thought VerificationLinzhuang Sun, Hao Liang, Jingxuan Wei, Bihui Yu et al.ACL 2025 · 38 citations
- Towards Faithful Reasoning in Remote Sensing: A Perceptually-Grounded GeoSpatial Chain-of-Thought for Vision-Language ModelsJiaqi Liu, Lang Sun, Ronghao Fu, Bo YangICLR 2026 · 22 citations
