ACL Findings2026
MeasHalu: Mitigation of Scientific Measurement Hallucinations for Large Language Models with Enhanced Reasoning
Ruijun Huang, Zhiqiao Kang, Yuxuan Zhu, Junxiong Li, Jiahao Zhao, Minghuan Tan, Feng Jiang, Min Yang
Abstract
The accurate extraction of scientific measurements from literature is a critical yet challenging task in AI4Science, enabling large-scale analysis and integration of quantitative research findings. However, Large Language Models (LLMs) frequently exhibit severe hallucinations, which significantly undermine the reliability of automated scientific document understanding systems. To address this problem, we propose MEASHALU, a novel framework for mitigating scientific measurement hallucinations through enhanced reasoning and targeted optimization. We first present a finegrained taxonomy of measurement-specific hallucinations, categorizing errors across quantities, units, modifiers, and relations. Our approach incorporates a two-stage reasoningaware fine-tuning strategy using augmented scientific data and process-based supervision. Furthermore, we introduce a progressive reward curriculum designed to penalize specific hallucination types, significantly improving extraction faithfulness. Experimental results demonstrate that MEASHALU substantially reduces hallucination rates and improves overall accuracy on the MeasEval benchmark. This work provides a targeted solution to a key bottleneck in automated scientific knowledge extraction, facilitating more trustworthy and scalable machine-assisted scientific literature analysis. Our codes and data are publicly available on https://github.com/CAS- SIAT-XinHai/MeasHalu.
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Builds on5
- Direct Preference Optimization: Your Language Model is Secretly a Reward ModelRafael Rafailov, Archit Sharma, Eric Mitchell, Christopher D. Manning et al.NeurIPS 2023 · 10,924 citations
- Let's Verify Step by StepHunter Lightman, Vineet Kosaraju, Yuri Burda, Harrison Edwards et al.ICLR 2024 · 3,045 citations
- ReactXT: Understanding Molecular "Reaction-ship" via Reaction-Contextualized Molecule-Text PretrainingZhiyuan Liu, Yaorui Shi, An Zhang, Sihang Li et al.ACL Findings 2024 · 4 citations
- CQE: A Comprehensive Quantity ExtractorSatya Almasian, Vivian Kazakova, Philip Göldner, Michael GertzEMNLP 2023 · 3 citations
- NUMCoT: Numerals and Units of Measurement in Chain-of-Thought Reasoning using Large Language ModelsAncheng Xu, Minghuan Tan, Lei Wang, Min Yang et al.ACL Findings 2024 · 1 citation
Related papers
- FactCheXcker: Mitigating Measurement Hallucinations in Chest X-ray Report Generation ModelsAlice Heiman, Xiaoman Zhang, Emma Chen, Sung Eun Kim et al.CVPR 2025
- PRISM: Probing Reasoning, Instruction, and Source Memory in LLM HallucinationsYuhe Wu, Guangyu Wang, Yuran Chen, Jiatong Zhang et al.ACL 2026
- Evaluating Evaluation Metrics - The Mirage of Hallucination DetectionAtharva Kulkarni, Yuan Zhang, Joel Ruben Antony Moniz, Xiou Ge et al.EMNLP Findings 2025 · 6 citations
- ChemActor: Enhancing Automated Extraction of Chemical Synthesis Actions with LLM-Generated DataYu Zhang, Ruijie Yu, Jidong Tian, Feng Zhu et al.ACL 2025 · 3 citations
- CodeHalu: Investigating Code Hallucinations in LLMs via Execution-based VerificationYuchen Tian, Weixiang Yan, Qian Yang, Xuandong Zhao et al.AAAI 2025 · 41 citations
