Lune

ICML2025Top-tier venue

Compositional Condition Question Answering in Tabular Understanding

Jun-Peng Jiang, Tao Zhou, De-Chuan Zhan, Han-Jia Ye

Abstract

Multimodal Large Language Models (MLLMs) for tabular understanding have made significant progress in tasks such as financial report analysis and public data tests. However, our comprehensive analysis shows that these models are still limited in certain simple scenarios, particularly when handling compositional conditions in QA. Further investigation reveals that the poor performance can be attributed to two main challenges: the visual encoder's inability to accurately recognize the content of a row, and the model's tendency to overlook conditions in the question. To address these, we introduce a new Compositional Condition Tabular Understanding method, called COCOTAB. Specifically, to capture the structural relationships within tables, we enhance the visual encoder with additional row and column patches. Moreover, we introduce the conditional tokens between the visual patches and query embeddings, ensuring the model focuses on relevant parts of the table according to the conditions specified in the query. Additionally, we also introduce the Massive Multimodal Tabular Understanding (MMTU) benchmark, which comprehensively assesses the full capabilities of MLLMs in tabular understanding. Our proposed method achieves state-of-the-art performance on both existing tabular understanding benchmarks and MMTU. Our code can be available at https: //github.com/LAMDA-Tabular/MMTU.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

4 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • LoRA: Low-Rank Adaptation of Large Language Models cites Language Models are Few-Shot Learners
  • TopBench: A Benchmark for Implicit Predictive Reasoning in Tabular Question Answering cites VT-Bench: A Unified Benchmark for Visual-Tabular Multi-Modal Learning
  • TopBench: A Benchmark for Implicit Predictive Reasoning in Tabular Question Answering cites Multimodal Tabular Reasoning with Privileged Structured Information
  • TopBench: A Benchmark for Implicit Predictive Reasoning in Tabular Question Answering cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
  • VT-Bench: A Unified Benchmark for Visual-Tabular Multi-Modal Learning cites Multimodal Tabular Reasoning with Privileged Structured Information
  • Feature-aware Modulation for Learning from Temporal Tabular Data cites Multimodal Tabular Reasoning with Privileged Structured Information
  • Multimodal Tabular Reasoning with Privileged Structured Information cites Feature-aware Modulation for Learning from Temporal Tabular Data
  • Learning Transferable Visual Models From Natural Language Supervision cites Language Models are Few-Shot Learners
  • Multimodal Tabular Reasoning with Privileged Structured Information cites Language Models are Few-Shot Learners
  • Multimodal Tabular Reasoning with Privileged Structured Information cites Learning Transferable Visual Models From Natural Language Supervision
  • Multimodal Tabular Reasoning with Privileged Structured Information cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
  • Multimodal Tabular Reasoning with Privileged Structured Information cites Training language models to follow instructions with human feedback
  • Chain-of-Thought Prompting Elicits Reasoning in Large Language Models cites Training language models to follow instructions with human feedback
  • Training language models to follow instructions with human feedback cites Language Models are Few-Shot Learners
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers4

  1. Multimodal Tabular Reasoning with Privileged Structured InformationJun-Peng Jiang, Yu Xia, Hai-Long Sun, Shiyin Lu et al.NeurIPS 2025 · 16 citations
  2. VT-Bench: A Unified Benchmark for Visual-Tabular Multi-Modal Learning贾 子怡, Zijian Cheng, Xinyue Zhang, Kun-Yang Yu et al.ICML 2026 · 3 citations
  3. Feature-aware Modulation for Learning from Temporal Tabular DataHaorun Cai, Han-Jia YeNeurIPS 2025 · 3 citations
  4. TopBench: A Benchmark for Implicit Predictive Reasoning in Tabular Question AnsweringAn-Yang Ji, Jun-Peng Jiang, De-Chuan Zhan, Han-Jia YeICML 2026 · 1 citation

Builds on36

  1. Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
  2. Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
  3. Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida et al.NeurIPS 2022 · 24,707 citations
  4. Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
  5. LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations

Related papers

  1. MMTableBench: A Multi-level Multimodal Benchmark for Reasoning and Layout Complexity in Table QAXianjie Wu, Xiaohang Xu, Tingyu Jiang, Jian Yang et al.WWW 2026 · 3 citations
  2. TabPedia: Towards Comprehensive Visual Table Understanding with Concept SynergyWeichao Zhao, Hao Feng, Qi Liu, Jingqun Tang et al.NeurIPS 2024 · 97 citations
  3. Multimodal Table UnderstandingMingyu Zheng, Xinwei Feng, Qingyi Si, Qiaoqiao She et al.ACL 2024
  4. MMTabReal: Real-World Benchmark for Multimodal Table UnderstandingPrasham Yatinkumar Titiya, Jainil Trivedi, Chitta Baral, Vivek GuptaACL Findings 2026
  5. CODIS: Benchmarking Context-dependent Visual Comprehension for Multimodal Large Language ModelsFuwen Luo, Chi Chen, Zihao Wan, Zhaolu Kang et al.ACL 2024 · 3 citations
Dusk over the sea between two cliffs drawn in fine vertical lines