ACL Findings2026
Streaming Hallucination Detection in Long Chain-of-Thought Reasoning
Haolang Lu, Minghui Pan, Ripeng Li, Guoshun Nan, Jialin Zhuang, Zijie Zhao, Zhongxiang Sun, Kun Wang, Yang Liu
Abstract
Long chain-of-thought (CoT) reasoning improves the performance of large language models, yet hallucinations in such settings often emerge subtly and propagate across reasoning steps.We suggest that hallucination in long CoT reasoning is better understood as an evolving latent state rather than a one-off erroneous event.Accordingly, we treat step-level hallucination judgments as local observations and introduce a cumulative prefix-level hallucination signal that tracks the global evolution of the reasoning state over the entire trajectory.Overall, our approach enables streaming hallucination detection in long CoT reasoning, providing real-time, interpretable evidence. Step-level Judgement
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
2 top-tier papers have cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
- Harnessing Reasoning Trajectories for Hallucination Detection via Answer-agreement Representation Shaping cites The Internal State of an LLM Knows When It's Lying
- Harnessing Reasoning Trajectories for Hallucination Detection via Answer-agreement Representation Shaping cites Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them
Cited by top-tier papers2
Builds on25
- Attention is not all you need: pure attention loses rank doubly exponentially with depthYihe Dong, Jean-Baptiste Cordonnier, Andreas LoukasICML 2021 · 522 citations
- Is DPO Superior to PPO for LLM Alignment? A Comprehensive StudyShusheng Xu, Wei Fu, Jiaxuan Gao, Wenjie Ye et al.ICML 2024 · 274 citations
- Physics of Language Models: Part 3.1, Knowledge Storage and ExtractionZeyuan Allen-Zhu, Yuanzhi LiICML 2024 · 258 citations
- Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve ThemMirac Suzgun, Nathan Scales, Nathanael Schärli, Sebastian Gehrmann et al.ACL Findings 2023 · 253 citations
- The Internal State of an LLM Knows When It's LyingAmos Azaria, Tom M. MitchellEMNLP Findings 2023 · 177 citations
Related papers
- Chain-of-Thought Prompting Obscures Hallucination Cues in Large Language Models: An Empirical EvaluationJiahao Cheng, Tiancheng Su, Jia Yuan, Guoxiu He et al.EMNLP Findings 2025 · 11 citations
- Explainable Chain-of-Thought Reasoning: An Empirical Analysis on State-Aware Reasoning DynamicsSheldon Yu, Yuxin Xiong, Junda Wu, Xintong Li et al.EMNLP Findings 2025
- Auditing Meta-Cognitive Hallucinations in Reasoning Large Language ModelsHaolang Lu, Yilian Liu, Jingxin Xu, Guoshun Nan et al.NeurIPS 2025 · 23 citations
- Understanding and Mitigating Hallucinations in Multimodal Chain-of-Thought ModelsJi Ma, Wei Suo, Peng Wang, Yanning ZhangCVPR 2026 · 3 citations
- ICR Probe: Tracking Hidden State Dynamics for Reliable Hallucination Detection in LLMsZhenliang Zhang, Xinyu Hu, Huixuan Zhang, Junzhe Zhang et al.ACL 2025 · 17 citations
