Lune

ICML2026Top-tier venue

MORE: A Multilingual Document Parsing Benchmark and Evaluation

Long Xu, Binghong Wu, TingHao YU, Hao Feng, zhenyuhuang, Haoqing Jiang, Yunhao Wang, Shuo Huang, feng zhang

2026Year
3Citations

Abstract

Multilingual documents encapsulate rich regional cultures, scientific discoveries, and historical records. Parsing this content into structured, machine-readable formats is critical for unlocking global knowledge. However, existing benchmarks predominantly focus on high-resource languages like English and Chinese, creating an evaluation blind spot\textit{evaluation blind spot} concerning model performance on other languages. While recent Vision-Language Models (VLMs) claim support for hundreds of languages, the lack of ground truth makes it impossible to empirically verify these capabilities. To bridge this gap, we introduce MORE\textbf{MORE}, a large-scale benchmark designed for multilingual document parsing evaluation. MORE distinguishes itself through three key dimensions: (1) Unprecedented Scale\textbf{Unprecedented Scale}: It covers 149 languages\textbf{149 languages}, making it the most linguistically diverse benchmark to date; (2) Structural Complexity\textbf{Structural Complexity}: Unlike previous works, it extends evaluation beyond plain text to include structural elements such as code blocks, tables, and catalogs; and (3) Data Authenticity\textbf{Data Authenticity}: All samples are curated from real-world documents via a model-assisted, human-refined annotation pipeline. We evaluate state-of-the-art models using MORE, establishing new performance baselines for long-tail languages and validating the benchmark's effectiveness in diagnosing model capabilities in realistic, diverse scenarios. The MORE dataset will be available at https://github.com/zimoqingfeng/MORE.

Ask about this paper

Your agent reads all of it.

Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.

Questions to start from

Your agent calls

Luneget_paper_fulltext

Ask in Lune

Free to start. No credit card required.

lune papers fulltext d55db73c-ed1a-4e0e-a2b2-10c492818f49

Builds on8

Related papers

Dusk over the sea between two cliffs drawn in fine vertical lines