MCHDoc: A Comprehensive Benchmark for Reading Multi-Carrier Chinese Historical Documents

Therefore, we present MCHDoc, a comprehensive benchmark for reading multi-carrier Chinese historical documents. MCH-Doc spans over 3,000 years of history and contains 15,724 high-resolution documents from six major carriers, capturing rich variations in material, layout, etc. Mimicking expert workflows, the benchmark supports page-level and character-level recognition, as well as LLM-based postcorrection with and without external knowledge. We systematically evaluate a wide range of large-scale models on MCHDoc. The results show that even top-tier models struggle with multi-carrier historical documents. Furthermore, our analysis highlights several key factors for effectively adapting large models to Chinese historical texts. MCHDoc thus offers a standardized, challenging, and historically grounded benchmark for reading Chinese historical documents and provides a foundation for future research in document analysis and digital humanities. The dataset will be released in https://github.com/ blackprotoss/MCHDoc.