ACL Findings2026
INDOTABVQA: A Benchmark for Cross-Lingual Table Understanding in Bahasa Indonesia Documents
Somraj Gautam, Anathapindika Dravichi, Gaurav Harit
Abstract
We introduce INDOTABVQA, a benchmark for evaluating cross-lingual Table Visual Question Answering (VQA) on real-world document images in Bahasa Indonesia.The dataset comprises 1,593 document images across three visual styles (bordered, borderless, and colorful) with one or more than one tables, and 1,593 question-answer sets in four languages: Bahasa Indonesia, English, Hindi, and Arabic.This enables evaluation of Vision-Language Models (VLMs) in both monolingual (Bahasa documents with Bahasa questions) and cross-lingual settings (Bahasa documents with questions in other languages).We benchmark leading open-source VLMs (Qwen2.5-VL,Gemma-3, LLaMA-3.2) and GPT-4o and reveal substantial performance gaps, particularly on structurally complex tables and in lowresource languages.Fine-tuning a compact 3B model and a LoRA-finetuned 7B model on our dataset yields 11.6% and 17.8% improvements in accuracy.Providing explicit table region coordinates as additional input further improves performance by 4-7%, demonstrating the value of Spatial priors for table-based reasoning.Our findings underscore the importance of language-diverse, domain-specific datasets and demonstrate that targeted finetuning can significantly enhance VLM performance on specialized document understanding tasks.INDOTABVQA provides a valuable resource for advancing research in crosslingual, structure-aware document understanding, especially in underrepresented regions of the world.The dataset is publicly available via Hugging Face at
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Builds on8
- TabFact: A Large-scale Dataset for Table-based Fact VerificationWenhu Chen, Hongmin Wang, Jianshu Chen, Yunkai Zhang et al.ICLR 2020 · 674 citations
- ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical ReasoningAhmed Masry, Do Xuan Long, Jia Qing Tan, Shafiq R. Joty et al.ACL Findings 2022 · 389 citations
- PubTables-1M: Towards comprehensive table extraction from unstructured documentsBrandon Smock, Rohith Pesala, Robin AbrahamCVPR 2022 · 125 citations
- MULE: Multimodal Universal Language EmbeddingDonghyun Kim, Kuniaki Saito, Kate Saenko, Stan Sclaroff et al.AAAI 2020 · 45 citations
- MaXM: Towards Multilingual Visual Question AnsweringSoravit Changpinyo, Linting Xue, Michal Yarom, Ashish V. Thapliyal et al.EMNLP Findings 2023 · 20 citations
Related papers
- M3TQA: Massively Multilingual Multitask Table Question AnsweringDaixin Shu, Jian Yang, Zhenhe Wu, Xianjie Wu et al.ACL Findings 2026
- Evaluating Large Vision Language Models on Bangla Medical Visual Question AnsweringRafid Ahmed, Intesar Tahmid, Mir Sazzat Hossain, Tasnimul Hossain Tomal et al.ACL Findings 2026 · 1 citation
- MTabVQA: Evaluating Multi-Tabular Reasoning of Language Models in Visual SpaceAnshul Singh, Chris Biemann, Jan StrichEMNLP Findings 2025
- TABLET: A Large-Scale Dataset for Robust Visual Table UnderstandingIñigo Alonso, Imanol Miranda, Eneko Agirre, Mirella LapataICLR 2026 · 5 citations
- IndicVisionBench: Benchmarking Cultural and Multilingual Understanding in VLMsAli Faraz, Akash, Shaharukh Khan, Raja Kolla et al.ICLR 2026 · 9 citations
