ACL Findings2026
INDOTABVQA: A Benchmark for Cross-Lingual Table Understanding in Bahasa Indonesia Documents
Somraj Gautam, Anathapindika Dravichi, Gaurav Harit
摘要
We introduce INDOTABVQA, a benchmark for evaluating cross-lingual Table Visual Question Answering (VQA) on real-world document images in Bahasa Indonesia.The dataset comprises 1,593 document images across three visual styles (bordered, borderless, and colorful) with one or more than one tables, and 1,593 question-answer sets in four languages: Bahasa Indonesia, English, Hindi, and Arabic.This enables evaluation of Vision-Language Models (VLMs) in both monolingual (Bahasa documents with Bahasa questions) and cross-lingual settings (Bahasa documents with questions in other languages).We benchmark leading open-source VLMs (Qwen2.5-VL,Gemma-3, LLaMA-3.2) and GPT-4o and reveal substantial performance gaps, particularly on structurally complex tables and in lowresource languages.Fine-tuning a compact 3B model and a LoRA-finetuned 7B model on our dataset yields 11.6% and 17.8% improvements in accuracy.Providing explicit table region coordinates as additional input further improves performance by 4-7%, demonstrating the value of Spatial priors for table-based reasoning.Our findings underscore the importance of language-diverse, domain-specific datasets and demonstrate that targeted finetuning can significantly enhance VLM performance on specialized document understanding tasks.INDOTABVQA provides a valuable resource for advancing research in crosslingual, structure-aware document understanding, especially in underrepresented regions of the world.The dataset is publicly available via Hugging Face at
问 Lune
尽管问,回答会引用原文。
Lune 会读完全文和相关的 Paper,每个回答都附上所依据的原文段落。
它引用的 Paper8
- TabFact: A Large-scale Dataset for Table-based Fact VerificationWenhu Chen, Hongmin Wang, Jianshu Chen, Yunkai Zhang 等ICLR 2020 · 674 次引用
- ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical ReasoningAhmed Masry, Do Xuan Long, Jia Qing Tan, Shafiq R. Joty 等ACL Findings 2022 · 389 次引用
- PubTables-1M: Towards comprehensive table extraction from unstructured documentsBrandon Smock, Rohith Pesala, Robin AbrahamCVPR 2022 · 125 次引用
- MULE: Multimodal Universal Language EmbeddingDonghyun Kim, Kuniaki Saito, Kate Saenko, Stan Sclaroff 等AAAI 2020 · 45 次引用
- MaXM: Towards Multilingual Visual Question AnsweringSoravit Changpinyo, Linting Xue, Michal Yarom, Ashish V. Thapliyal 等EMNLP Findings 2023 · 20 次引用
相关 Paper
- M3TQA: Massively Multilingual Multitask Table Question AnsweringDaixin Shu, Jian Yang, Zhenhe Wu, Xianjie Wu 等ACL Findings 2026
- Evaluating Large Vision Language Models on Bangla Medical Visual Question AnsweringRafid Ahmed, Intesar Tahmid, Mir Sazzat Hossain, Tasnimul Hossain Tomal 等ACL Findings 2026 · 1 次引用
- MTabVQA: Evaluating Multi-Tabular Reasoning of Language Models in Visual SpaceAnshul Singh, Chris Biemann, Jan StrichEMNLP Findings 2025
- TABLET: A Large-Scale Dataset for Robust Visual Table UnderstandingIñigo Alonso, Imanol Miranda, Eneko Agirre, Mirella LapataICLR 2026 · 5 次引用
- IndicVisionBench: Benchmarking Cultural and Multilingual Understanding in VLMsAli Faraz, Akash, Shaharukh Khan, Raja Kolla 等ICLR 2026 · 9 次引用
