RePanda: Pandas-powered Tabular Verification and Reasoning
Atoosa Malemir Chegini, Keivan Rezaei, Hamid Eghbalzadeh, Soheil Feizi
Abstract
Fact-checking tabular data is essential for ensuring the accuracy of structured information. However, existing methods often rely on blackbox models with opaque reasoning. We introduce RePanda, a structured fact verification approach that translates claims into executable pandas queries, enabling interpretable and verifiable reasoning. To train RePanda, we construct PanTabFact, a structured dataset derived from the TabFact train set, where claims are paired with executable queries generated using DeepSeek-Chat 1 and refined through automated error correction. Fine-tuning DeepSeek-coder-7Binstruct-v1.5 on PanTabFact, RePanda achieves 84.09% accuracy on the TabFact test set. To evaluate Out-of-Distribution (OOD) generalization, we interpret question-answer pairs from WikiTableQuestions as factual claims and refer to this dataset as WikiFact. Without additional fine-tuning, RePanda achieves 84.72% accuracy on WikiFact, significantly outperforming all other baselines and demonstrating strong OOD robustness. Notably, these results closely match the zero-shot performance of DeepSeek-Chat (671B), indicating that our fine-tuning approach effectively distills structured reasoning from a much larger model into a compact, locally executable 7B model. Beyond fact verification, RePanda extends to tabular question answering by generating executable queries that retrieve precise answers. To support this, we introduce PanWiki, a dataset mapping WikiTableQuestions to pandas queries. Fine-tuning on PanWiki, RePanda achieves 75.1% accuracy in direct answer retrieval. These results highlight the effectiveness of structured 1 All experiments, data collection, and processing activities were conducted by the University of Maryland, College Park (UMD). Meta was involved solely in an advisory role and no experiments, data collection or processing activities were conducted using Meta tools or within its IT environment. execution-based reasoning for tabular verification and question answering. We have publicly released the dataset on Hugging Face at datasets/AtoosaChegini/PanTabFact.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on11
- Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
- TabFact: A Large-scale Dataset for Table-based Fact VerificationWenhu Chen, Hongmin Wang, Jianshu Chen, Yunkai Zhang et al.ICLR 2020 · 674 citations
- TaBERT: Pretraining for Joint Understanding of Textual and Tabular DataPengcheng Yin, Graham Neubig, Wen-tau Yih, Sebastian RiedelACL 2020 · 417 citations
- TAPEX: Table Pre-training via Learning a Neural SQL ExecutorQian Liu, Bei Chen, Jiaqi Guo, Morteza Ziyadi et al.ICLR 2022 · 347 citations
- StructGPT: A General Framework for Large Language Model to Reason over Structured DataJinhao Jiang, Kun Zhou, Zican Dong, Keming Ye et al.EMNLP 2023 · 173 citations
Related papers
- ReasTAP: Injecting Table Reasoning Skills During Pre-training via Synthetic Reasoning ExamplesYilun Zhao, Linyong Nan, Zhenting Qi, Rui Zhang et al.EMNLP 2022 · 15 citations
- PASTA: Table-Operations Aware Fact Verification via Sentence-Table Cloze Pre-trainingZihui Gu, Ju Fan, Nan Tang, Preslav Nakov et al.EMNLP 2022 · 19 citations
- API-Assisted Code Generation for Question Answering on Varied Table StructuresYihan Cao, Shuyi Chen, Ryan Liu, Zhiruo Wang et al.EMNLP 2023 · 6 citations
- Table-R1: Inference-Time Scaling for Table Reasoning TasksZheyuan Yang, Lyuhao Chen, Arman Cohan, Yilun ZhaoEMNLP 2025 · 2 citations
- Large Language Models are Versatile Decomposers: Decomposing Evidence and Questions for Table-based ReasoningYunhu Ye, Binyuan Hui, Min Yang, Binhua Li et al.SIGIR 2023 · 75 citations
