Lune

ACL Findings2026

INDOTABVQA: A Benchmark for Cross-Lingual Table Understanding in Bahasa Indonesia Documents

Somraj Gautam, Anathapindika Dravichi, Gaurav Harit

摘要

We introduce INDOTABVQA, a benchmark for evaluating cross-lingual Table Visual Question Answering (VQA) on real-world document images in Bahasa Indonesia.The dataset comprises 1,593 document images across three visual styles (bordered, borderless, and colorful) with one or more than one tables, and 1,593 question-answer sets in four languages: Bahasa Indonesia, English, Hindi, and Arabic.This enables evaluation of Vision-Language Models (VLMs) in both monolingual (Bahasa documents with Bahasa questions) and cross-lingual settings (Bahasa documents with questions in other languages).We benchmark leading open-source VLMs (Qwen2.5-VL,Gemma-3, LLaMA-3.2) and GPT-4o and reveal substantial performance gaps, particularly on structurally complex tables and in lowresource languages.Fine-tuning a compact 3B model and a LoRA-finetuned 7B model on our dataset yields 11.6% and 17.8% improvements in accuracy.Providing explicit table region coordinates as additional input further improves performance by 4-7%, demonstrating the value of Spatial priors for table-based reasoning.Our findings underscore the importance of language-diverse, domain-specific datasets and demonstrate that targeted finetuning can significantly enhance VLM performance on specialized document understanding tasks.INDOTABVQA provides a valuable resource for advancing research in crosslingual, structure-aware document understanding, especially in underrepresented regions of the world.The dataset is publicly available via Hugging Face at

问 Lune

尽管问,回答会引用原文。

Lune 会读完全文和相关的 Paper,每个回答都附上所依据的原文段落。

可以从这些问题问起

Lune 的依据

全文 · 相关的 Paper

获取答案

免费开始,无需绑卡

它引用的 Paper8

  1. TabFact: A Large-scale Dataset for Table-based Fact VerificationWenhu Chen, Hongmin Wang, Jianshu Chen, Yunkai Zhang 等ICLR 2020 · 674 次引用
  2. ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical ReasoningAhmed Masry, Do Xuan Long, Jia Qing Tan, Shafiq R. Joty 等ACL Findings 2022 · 389 次引用
  3. PubTables-1M: Towards comprehensive table extraction from unstructured documentsBrandon Smock, Rohith Pesala, Robin AbrahamCVPR 2022 · 125 次引用
  4. MULE: Multimodal Universal Language EmbeddingDonghyun Kim, Kuniaki Saito, Kate Saenko, Stan Sclaroff 等AAAI 2020 · 45 次引用
  5. MaXM: Towards Multilingual Visual Question AnsweringSoravit Changpinyo, Linting Xue, Michal Yarom, Ashish V. Thapliyal 等EMNLP Findings 2023 · 20 次引用

相关 Paper

  1. M3TQA: Massively Multilingual Multitask Table Question AnsweringDaixin Shu, Jian Yang, Zhenhe Wu, Xianjie Wu 等ACL Findings 2026
  2. Evaluating Large Vision Language Models on Bangla Medical Visual Question AnsweringRafid Ahmed, Intesar Tahmid, Mir Sazzat Hossain, Tasnimul Hossain Tomal 等ACL Findings 2026 · 1 次引用
  3. MTabVQA: Evaluating Multi-Tabular Reasoning of Language Models in Visual SpaceAnshul Singh, Chris Biemann, Jan StrichEMNLP Findings 2025
  4. TABLET: A Large-Scale Dataset for Robust Visual Table UnderstandingIñigo Alonso, Imanol Miranda, Eneko Agirre, Mirella LapataICLR 2026 · 5 次引用
  5. IndicVisionBench: Benchmarking Cultural and Multilingual Understanding in VLMsAli Faraz, Akash, Shaharukh Khan, Raja Kolla 等ICLR 2026 · 9 次引用
黄昏的海面,两侧是细线勾勒的悬崖