ACL Findings2026
MeasHalu: Mitigation of Scientific Measurement Hallucinations for Large Language Models with Enhanced Reasoning
Ruijun Huang, Zhiqiao Kang, Yuxuan Zhu, Junxiong Li, Jiahao Zhao, Minghuan Tan, Feng Jiang, Min Yang
摘要
The accurate extraction of scientific measurements from literature is a critical yet challenging task in AI4Science, enabling large-scale analysis and integration of quantitative research findings. However, Large Language Models (LLMs) frequently exhibit severe hallucinations, which significantly undermine the reliability of automated scientific document understanding systems. To address this problem, we propose MEASHALU, a novel framework for mitigating scientific measurement hallucinations through enhanced reasoning and targeted optimization. We first present a finegrained taxonomy of measurement-specific hallucinations, categorizing errors across quantities, units, modifiers, and relations. Our approach incorporates a two-stage reasoningaware fine-tuning strategy using augmented scientific data and process-based supervision. Furthermore, we introduce a progressive reward curriculum designed to penalize specific hallucination types, significantly improving extraction faithfulness. Experimental results demonstrate that MEASHALU substantially reduces hallucination rates and improves overall accuracy on the MeasEval benchmark. This work provides a targeted solution to a key bottleneck in automated scientific knowledge extraction, facilitating more trustworthy and scalable machine-assisted scientific literature analysis. Our codes and data are publicly available on https://github.com/CAS- SIAT-XinHai/MeasHalu.
问 Lune
尽管问,回答会引用原文。
Lune 会读完全文和相关的 Paper,每个回答都附上所依据的原文段落。
它引用的 Paper5
- Direct Preference Optimization: Your Language Model is Secretly a Reward ModelRafael Rafailov, Archit Sharma, Eric Mitchell, Christopher D. Manning 等NeurIPS 2023 · 10,924 次引用
- Let's Verify Step by StepHunter Lightman, Vineet Kosaraju, Yuri Burda, Harrison Edwards 等ICLR 2024 · 3,045 次引用
- ReactXT: Understanding Molecular "Reaction-ship" via Reaction-Contextualized Molecule-Text PretrainingZhiyuan Liu, Yaorui Shi, An Zhang, Sihang Li 等ACL Findings 2024 · 4 次引用
- CQE: A Comprehensive Quantity ExtractorSatya Almasian, Vivian Kazakova, Philip Göldner, Michael GertzEMNLP 2023 · 3 次引用
- NUMCoT: Numerals and Units of Measurement in Chain-of-Thought Reasoning using Large Language ModelsAncheng Xu, Minghuan Tan, Lei Wang, Min Yang 等ACL Findings 2024 · 1 次引用
相关 Paper
- FactCheXcker: Mitigating Measurement Hallucinations in Chest X-ray Report Generation ModelsAlice Heiman, Xiaoman Zhang, Emma Chen, Sung Eun Kim 等CVPR 2025
- PRISM: Probing Reasoning, Instruction, and Source Memory in LLM HallucinationsYuhe Wu, Guangyu Wang, Yuran Chen, Jiatong Zhang 等ACL 2026
- Evaluating Evaluation Metrics - The Mirage of Hallucination DetectionAtharva Kulkarni, Yuan Zhang, Joel Ruben Antony Moniz, Xiou Ge 等EMNLP Findings 2025 · 6 次引用
- ChemActor: Enhancing Automated Extraction of Chemical Synthesis Actions with LLM-Generated DataYu Zhang, Ruijie Yu, Jidong Tian, Feng Zhu 等ACL 2025 · 3 次引用
- CodeHalu: Investigating Code Hallucinations in LLMs via Execution-based VerificationYuchen Tian, Weixiang Yan, Qian Yang, Xuandong Zhao 等AAAI 2025 · 41 次引用
