Towards Interpretable Tabular Reasoning: Enhancing LLM Reasoning on Tabular Data with Pre-Constructed Logic Graph
Lirong Gao, Zewei Yu, Zhongrui Yin, Qi Zhang, Yuke Zhu, Bo Zheng, Haobo Wang, Junbo Zhao, Gang Chen, Sheng Guo
Abstract
Tabular data analysis is critical in highstakes domains like finance and healthcare, where both accuracy and interpretability are paramount. Traditional tree-based models excel in performance but suffer from poor interpretability and reliance on rigid feature engineering. Large Language Models (LLMs), while transparent in reasoning, often fail to capture the precise statistical distributions needed for accurate tabular prediction. To bridge this gap, we propose LogGER (Logic-Graph-Enhanced LLM Reasoning), a novel framework that harmonizes the predictive power of trees with the reasoning transparency of LLMs. Unlike existing hybrids, LogGER explicitly distills statistical patterns from data priors into a human-readable Logic Graph, transforming numerical decision into correlation semantic chains. This graph then serves as a verifier for our Process Supervision mechanism. Specifically, we employ a process reward model that steers the LLM's intermediate reasoning steps, ensuring alignment with the established logic graph. Extensive experiments demonstrate that LogGER not only achieves state-of-the-art accuracy, consistently outperforming both treebased models and LLM baselines, but also provides verifiable, transparent decision paths, establishing a new paradigm for interpretable tabular reasoning.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext ea6f6a35-fd29-493a-86f9-baf3c905a925Builds on14
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
- Tree of Thoughts: Deliberate Problem Solving with Large Language ModelsShunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran et al.NeurIPS 2023 · 5,068 citations
- Revisiting Deep Learning Models for Tabular DataYury Gorishniy, Ivan Rubachev, Valentin Khrulkov, Artem BabenkoNeurIPS 2021 · 1,847 citations
- ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree SearchDan Zhang, Sining Zhoubian, Ziniu Hu, Yisong Yue et al.NeurIPS 2024 · 527 citations
Related papers
- LLM Meeting Decision Trees on Tabular DataHangting Ye, Jinmeng Li, He Zhao, Dandan Guo et al.NeurIPS 2025 · 8 citations
- Optimized Feature Generation for Tabular Data via LLMs with Decision Tree ReasoningJaehyun Nam, Kyuyoung Kim, Seunghyuk Oh, Jihoon Tack et al.NeurIPS 2024 · 78 citations
- CoT4Rec: Revealing User Preferences Through Chain of Thought for Recommender SystemsWeiqi Yue, Yuyu Yin, Xin Zhang, Binbin Shi et al.AAAI 2025 · 10 citations
- PathMind: A Retrieve-Prioritize-Reason Framework for Knowledge Graph Reasoning with Large Language ModelsYu Liu, Xixun Lin, Yanmin Shang, Yangxi Li et al.AAAI 2026 · 3 citations
- Reasoning on Graphs: Faithful and Interpretable Large Language Model ReasoningLinhao Luo, Yuan-Fang Li, Gholamreza Haffari, Shirui PanICLR 2024 · 499 citations
