Lune

ACL Findings2026

Hallucination Detection in Long-Form Text Generated by LLMs: A Benchmark and a Hyper-Relational Knowledge Graph Approach

Zituo Li, Guangzhou Chen, Jianbin Sun, Qi Song, Kewei Yang

摘要

Hallucination detection has received increasing attention, particularly in long-form text generation, where language models are more prone to producing factually inaccurate content. Previous studies reveal two limitations: (1) current benchmarks focus on short-form content, lacking the structural complexity required in long-form scenarios; (2) existing methods are constrained by coarse-grained consistency checks and fail to capture long-range and hyperrelational dependencies. To address these challenges, we provide LHD, a benchmark for longform hallucination detection that contains diverse entity types and intricate factual dependencies spanning extended contexts. We further propose HRKG-HD, a black-box framework that models responses as fact-centric hyperrelational knowledge graphs and detects hallucinations through relation-aware multi-hop reasoning over these graphs. By linking distant facts through shared entities and qualifiers, this design enables a global and dependency-aware verification of factual consistency. Extensive experiments demonstrate that HRKG-HD not only outperforms existing baselines at both the passage-level and sentence-level, but also exhibits robust and consistent performance across various LLMs. The code and dataset will be released upon acceptance to facilitate reproducibility.

问 Lune

尽管问,回答会引用原文。

Lune 会读完全文和相关的 Paper,每个回答都附上所依据的原文段落。

可以从这些问题问起

Lune 的依据

全文 · 相关的 Paper

获取答案

免费开始,无需绑卡

它引用的 Paper12

  1. Long Range Arena : A Benchmark for Efficient TransformersYi Tay, Mostafa Dehghani, Samira Abnar, Yikang Shen 等ICLR 2021 · 881 次引用
  2. SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language ModelsPotsawee Manakul, Adian Liusie, Mark J. F. GalesEMNLP 2023 · 331 次引用
  3. Kernel Language Entropy: Fine-grained Uncertainty Quantification for LLMs from Semantic SimilaritiesAlexander Nikitin, Jannik Kossen, Yarin Gal, Pekka MarttinenNeurIPS 2024 · 197 次引用
  4. Unsupervised Real-Time Hallucination Detection based on the Internal States of Large Language ModelsWeihang Su, Changyue Wang, Qingyao Ai, Yiran Hu 等ACL Findings 2024 · 47 次引用
  5. Drowzee: Metamorphic Testing for Fact-Conflicting Hallucination Detection in Large Language ModelsNingke Li, Yuekang Li, Yi Liu, Ling Shi 等OOPSLA 2024 · 26 次引用

相关 Paper

  1. Rethinking Evaluation for LLM Hallucination Detection: A Desiderata, A New RAG-based Benchmark, New InsightsWenbo Chen, Veena Padmanabhan, Tootiya Giyahchi, Elaine Wong 等ACL 2026 · 1 次引用
  2. Long-form Hallucination Detection with Self-elicitationZihang Liu, Jiawei Guo, Hao Zhang, Hongyang Chen 等ACL Findings 2025 · 5 次引用
  3. Zero-resource Hallucination Detection for Text Generation via Graph-based Contextual Knowledge Triples ModelingXinyue Fang, Zhen Huang, Zhiliang Tian, Minghui Fang 等AAAI 2025 · 11 次引用
  4. MultiHal: Multilingual Dataset for Knowledge-Graph Grounded Evaluation of LLM HallucinationsErnests Lavrinovics, Russa Biswas, Katja Hose, Johannes BjervaICML 2026 · 5 次引用
  5. Evidence-Aligned Entity Verification for Hallucination Detection in Retrieval-Augmented GenerationRunsong Jia, Zhen Fang, Mengjia Wu, Jie Lu 等ACL Findings 2026 · 2 次引用
黄昏的海面,两侧是细线勾勒的悬崖