Lune

ICML2026顶会

MORE: A Multilingual Document Parsing Benchmark and Evaluation

Long Xu, Binghong Wu, TingHao YU, Hao Feng, zhenyuhuang, Haoqing Jiang, Yunhao Wang, Shuo Huang, feng zhang

2026年份
3被引次数

摘要

Multilingual documents encapsulate rich regional cultures, scientific discoveries, and historical records. Parsing this content into structured, machine-readable formats is critical for unlocking global knowledge. However, existing benchmarks predominantly focus on high-resource languages like English and Chinese, creating an evaluation blind spot\textit{evaluation blind spot} concerning model performance on other languages. While recent Vision-Language Models (VLMs) claim support for hundreds of languages, the lack of ground truth makes it impossible to empirically verify these capabilities. To bridge this gap, we introduce MORE\textbf{MORE}, a large-scale benchmark designed for multilingual document parsing evaluation. MORE distinguishes itself through three key dimensions: (1) Unprecedented Scale\textbf{Unprecedented Scale}: It covers 149 languages\textbf{149 languages}, making it the most linguistically diverse benchmark to date; (2) Structural Complexity\textbf{Structural Complexity}: Unlike previous works, it extends evaluation beyond plain text to include structural elements such as code blocks, tables, and catalogs; and (3) Data Authenticity\textbf{Data Authenticity}: All samples are curated from real-world documents via a model-assisted, human-refined annotation pipeline. We evaluate state-of-the-art models using MORE, establishing new performance baselines for long-tail languages and validating the benchmark's effectiveness in diagnosing model capabilities in realistic, diverse scenarios. The MORE dataset will be available at https://github.com/zimoqingfeng/MORE.

问问这篇 Paper

智能体会读完全文。

Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。

可以从这些问题问起

智能体调用

Luneget_paper_fulltext

在 Lune 里问

免费开始,无需绑卡

lune papers fulltext d55db73c-ed1a-4e0e-a2b2-10c492818f49

它引用的顶会 Paper8

相关 Paper

黄昏的海面,两侧是细线勾勒的悬崖