Towards Interpretable Tabular Reasoning: Enhancing LLM Reasoning on Tabular Data with Pre-Constructed Logic Graph
Lirong Gao, Zewei Yu, Zhongrui Yin, Qi Zhang, Yuke Zhu, Bo Zheng, Haobo Wang, Junbo Zhao, Gang Chen, Sheng Guo
摘要
Tabular data analysis is critical in highstakes domains like finance and healthcare, where both accuracy and interpretability are paramount. Traditional tree-based models excel in performance but suffer from poor interpretability and reliance on rigid feature engineering. Large Language Models (LLMs), while transparent in reasoning, often fail to capture the precise statistical distributions needed for accurate tabular prediction. To bridge this gap, we propose LogGER (Logic-Graph-Enhanced LLM Reasoning), a novel framework that harmonizes the predictive power of trees with the reasoning transparency of LLMs. Unlike existing hybrids, LogGER explicitly distills statistical patterns from data priors into a human-readable Logic Graph, transforming numerical decision into correlation semantic chains. This graph then serves as a verifier for our Process Supervision mechanism. Specifically, we employ a process reward model that steers the LLM's intermediate reasoning steps, ensuring alignment with the established logic graph. Extensive experiments demonstrate that LogGER not only achieves state-of-the-art accuracy, consistently outperforming both treebased models and LLM baselines, but also provides verifiable, transparent decision paths, establishing a new paradigm for interpretable tabular reasoning.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper14
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah 等NeurIPS 2020 · 被引用 64,255 次
- Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma 等NeurIPS 2022 · 被引用 22,562 次
- Tree of Thoughts: Deliberate Problem Solving with Large Language ModelsShunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran 等NeurIPS 2023 · 被引用 5,068 次
- Revisiting Deep Learning Models for Tabular DataYury Gorishniy, Ivan Rubachev, Valentin Khrulkov, Artem BabenkoNeurIPS 2021 · 被引用 1,847 次
- ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree SearchDan Zhang, Sining Zhoubian, Ziniu Hu, Yisong Yue 等NeurIPS 2024 · 被引用 527 次
相关 Paper
- LLM Meeting Decision Trees on Tabular DataHangting Ye, Jinmeng Li, He Zhao, Dandan Guo 等NeurIPS 2025 · 被引用 8 次
- Optimized Feature Generation for Tabular Data via LLMs with Decision Tree ReasoningJaehyun Nam, Kyuyoung Kim, Seunghyuk Oh, Jihoon Tack 等NeurIPS 2024 · 被引用 78 次
- CoT4Rec: Revealing User Preferences Through Chain of Thought for Recommender SystemsWeiqi Yue, Yuyu Yin, Xin Zhang, Binbin Shi 等AAAI 2025 · 被引用 10 次
- PathMind: A Retrieve-Prioritize-Reason Framework for Knowledge Graph Reasoning with Large Language ModelsYu Liu, Xixun Lin, Yanmin Shang, Yangxi Li 等AAAI 2026 · 被引用 3 次
- Reasoning on Graphs: Faithful and Interpretable Large Language Model ReasoningLinhao Luo, Yuan-Fang Li, Gholamreza Haffari, Shirui PanICLR 2024 · 被引用 499 次
