Lune

ACL Findings2026

Hallucination Detection in Long-Form Text Generated by LLMs: A Benchmark and a Hyper-Relational Knowledge Graph Approach

Zituo Li, Guangzhou Chen, Jianbin Sun, Qi Song, Kewei Yang

Abstract

Hallucination detection has received increasing attention, particularly in long-form text generation, where language models are more prone to producing factually inaccurate content. Previous studies reveal two limitations: (1) current benchmarks focus on short-form content, lacking the structural complexity required in long-form scenarios; (2) existing methods are constrained by coarse-grained consistency checks and fail to capture long-range and hyperrelational dependencies. To address these challenges, we provide LHD, a benchmark for longform hallucination detection that contains diverse entity types and intricate factual dependencies spanning extended contexts. We further propose HRKG-HD, a black-box framework that models responses as fact-centric hyperrelational knowledge graphs and detects hallucinations through relation-aware multi-hop reasoning over these graphs. By linking distant facts through shared entities and qualifiers, this design enables a global and dependency-aware verification of factual consistency. Extensive experiments demonstrate that HRKG-HD not only outperforms existing baselines at both the passage-level and sentence-level, but also exhibits robust and consistent performance across various LLMs. The code and dataset will be released upon acceptance to facilitate reproducibility.

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · related work

Get the answer

Free to start. No credit card required.

Builds on12

  1. Long Range Arena : A Benchmark for Efficient TransformersYi Tay, Mostafa Dehghani, Samira Abnar, Yikang Shen et al.ICLR 2021 · 881 citations
  2. SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language ModelsPotsawee Manakul, Adian Liusie, Mark J. F. GalesEMNLP 2023 · 331 citations
  3. Kernel Language Entropy: Fine-grained Uncertainty Quantification for LLMs from Semantic SimilaritiesAlexander Nikitin, Jannik Kossen, Yarin Gal, Pekka MarttinenNeurIPS 2024 · 197 citations
  4. Unsupervised Real-Time Hallucination Detection based on the Internal States of Large Language ModelsWeihang Su, Changyue Wang, Qingyao Ai, Yiran Hu et al.ACL Findings 2024 · 47 citations
  5. Drowzee: Metamorphic Testing for Fact-Conflicting Hallucination Detection in Large Language ModelsNingke Li, Yuekang Li, Yi Liu, Ling Shi et al.OOPSLA 2024 · 26 citations

Related papers

  1. Rethinking Evaluation for LLM Hallucination Detection: A Desiderata, A New RAG-based Benchmark, New InsightsWenbo Chen, Veena Padmanabhan, Tootiya Giyahchi, Elaine Wong et al.ACL 2026 · 1 citation
  2. Long-form Hallucination Detection with Self-elicitationZihang Liu, Jiawei Guo, Hao Zhang, Hongyang Chen et al.ACL Findings 2025 · 5 citations
  3. Zero-resource Hallucination Detection for Text Generation via Graph-based Contextual Knowledge Triples ModelingXinyue Fang, Zhen Huang, Zhiliang Tian, Minghui Fang et al.AAAI 2025 · 11 citations
  4. MultiHal: Multilingual Dataset for Knowledge-Graph Grounded Evaluation of LLM HallucinationsErnests Lavrinovics, Russa Biswas, Katja Hose, Johannes BjervaICML 2026 · 5 citations
  5. Evidence-Aligned Entity Verification for Hallucination Detection in Retrieval-Augmented GenerationRunsong Jia, Zhen Fang, Mengjia Wu, Jie Lu et al.ACL Findings 2026 · 2 citations
Dusk over the sea between two cliffs drawn in fine vertical lines