ACL Findings2025
MHALO: Evaluating MLLMs as Fine-grained Hallucination Detectors
Yishuo Cai, Renjie Gu, Jiaxu Li, Xuancheng Huang, Junzhe Chen, Xiaotao Gu, Minlie Huang
Abstract
Hallucination remains a critical challenge for multimodal large language models (MLLMs), undermining their reliability in real-world applications.While fine-grained hallucination detection (FHD) holds promise for enhancing high-quality vision-language data construction and model alignment through enriched feedback signals, automated solutions for this task have yet to be systematically explored.Inspired by the concept of "MLLM as a Judge", we introduce MHALO, the first comprehensive benchmark specifically designed for evaluating MLLMs' capability in performing token-level FHD.Our benchmark encompasses 12 distinct hallucination types spanning both multimodal perception and reasoning domains.Through extensive evaluations of 9 selected MLLMs, we reveal substantial performance limitations, with the leading model achieving an average F 1 IoU of only 40.59%.To address this limitation, we develop HALODET-4B, a specialized model trained on our curated training data, which significantly outperforms existing models.We hope the benchmark can provide valuable insights for future research on hallucination mitigation in MLLMs.The code and dataset will be publicly available at https: //github.com/walkeralan123/MHALO. ⋄ Work
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
1 top-tier paper has cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
- Self-Consistency Improves Chain of Thought Reasoning in Language Models cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
- Chain-of-Thought Prompting Elicits Reasoning in Large Language Models cites Self-Consistency Improves Chain of Thought Reasoning in Language Models
- A Survey on In-context Learning cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
- MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts cites Self-Consistency Improves Chain of Thought Reasoning in Language Models
- MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
Cited by top-tier papers1
Builds on19
- Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
- Sigmoid Loss for Language Image Pre-TrainingXiaohua Zhai, Basil Mustafa, Alexander Kolesnikov, Lucas BeyerICCV 2023 · 2,932 citations
- MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual ContextsPan Lu, Hritik Bansal, Tony Xia, Jiacheng Liu et al.ICLR 2024 · 1,472 citations
- Self-Consistency Improves Chain of Thought Reasoning in Language ModelsXuezhi Wang, Jason Wei, Dale Schuurmans, Quoc V. Le et al.ICLR 2023 · 681 citations
- A Survey on In-context LearningQingxiu Dong, Lei Li, Damai Dai, Ce Zheng et al.EMNLP 2024 · 479 citations
Related papers
- Unified Hallucination Detection for Multimodal Large Language ModelsXiang Chen, Chenxi Wang, Yida Xue, Ningyu Zhang et al.ACL 2024 · 20 citations
- Detecting and Preventing Hallucinations in Large Vision Language ModelsAnisha Gunjal, Jihan Yin, Erhan BasAAAI 2024 · 312 citations
- ZINA: Multimodal Fine-grained Hallucination Detection and EditingYuiga Wada, Kazuki Matsuda, Komei Sugiura, Graham NeubigCVPR 2026 · 5 citations
- Hallu-PI: Evaluating Hallucination in Multi-modal Large Language Models within Perturbed InputsPeng Ding, Jingyu Wu, Jun Kuang, Dan Ma et al.ACM MM 2024 · 8 citations
- The Dawn After the Dark: An Empirical Study on Factuality Hallucination in Large Language ModelsJunyi Li, Jie Chen, Ruiyang Ren, Xiaoxue Cheng et al.ACL 2024 · 49 citations
