ACL Findings2026
Hallucination Detection in Long-Form Text Generated by LLMs: A Benchmark and a Hyper-Relational Knowledge Graph Approach
Zituo Li, Guangzhou Chen, Jianbin Sun, Qi Song, Kewei Yang
摘要
Hallucination detection has received increasing attention, particularly in long-form text generation, where language models are more prone to producing factually inaccurate content. Previous studies reveal two limitations: (1) current benchmarks focus on short-form content, lacking the structural complexity required in long-form scenarios; (2) existing methods are constrained by coarse-grained consistency checks and fail to capture long-range and hyperrelational dependencies. To address these challenges, we provide LHD, a benchmark for longform hallucination detection that contains diverse entity types and intricate factual dependencies spanning extended contexts. We further propose HRKG-HD, a black-box framework that models responses as fact-centric hyperrelational knowledge graphs and detects hallucinations through relation-aware multi-hop reasoning over these graphs. By linking distant facts through shared entities and qualifiers, this design enables a global and dependency-aware verification of factual consistency. Extensive experiments demonstrate that HRKG-HD not only outperforms existing baselines at both the passage-level and sentence-level, but also exhibits robust and consistent performance across various LLMs. The code and dataset will be released upon acceptance to facilitate reproducibility.
问 Lune
尽管问,回答会引用原文。
Lune 会读完全文和相关的 Paper,每个回答都附上所依据的原文段落。
它引用的 Paper12
- Long Range Arena : A Benchmark for Efficient TransformersYi Tay, Mostafa Dehghani, Samira Abnar, Yikang Shen 等ICLR 2021 · 881 次引用
- SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language ModelsPotsawee Manakul, Adian Liusie, Mark J. F. GalesEMNLP 2023 · 331 次引用
- Kernel Language Entropy: Fine-grained Uncertainty Quantification for LLMs from Semantic SimilaritiesAlexander Nikitin, Jannik Kossen, Yarin Gal, Pekka MarttinenNeurIPS 2024 · 197 次引用
- Unsupervised Real-Time Hallucination Detection based on the Internal States of Large Language ModelsWeihang Su, Changyue Wang, Qingyao Ai, Yiran Hu 等ACL Findings 2024 · 47 次引用
- Drowzee: Metamorphic Testing for Fact-Conflicting Hallucination Detection in Large Language ModelsNingke Li, Yuekang Li, Yi Liu, Ling Shi 等OOPSLA 2024 · 26 次引用
相关 Paper
- Rethinking Evaluation for LLM Hallucination Detection: A Desiderata, A New RAG-based Benchmark, New InsightsWenbo Chen, Veena Padmanabhan, Tootiya Giyahchi, Elaine Wong 等ACL 2026 · 1 次引用
- Long-form Hallucination Detection with Self-elicitationZihang Liu, Jiawei Guo, Hao Zhang, Hongyang Chen 等ACL Findings 2025 · 5 次引用
- Zero-resource Hallucination Detection for Text Generation via Graph-based Contextual Knowledge Triples ModelingXinyue Fang, Zhen Huang, Zhiliang Tian, Minghui Fang 等AAAI 2025 · 11 次引用
- MultiHal: Multilingual Dataset for Knowledge-Graph Grounded Evaluation of LLM HallucinationsErnests Lavrinovics, Russa Biswas, Katja Hose, Johannes BjervaICML 2026 · 5 次引用
- Evidence-Aligned Entity Verification for Hallucination Detection in Retrieval-Augmented GenerationRunsong Jia, Zhen Fang, Mengjia Wu, Jie Lu 等ACL Findings 2026 · 2 次引用
