ACL Findings2026
When Facts Change: Temporal Knowledge Conflict Resolution in LLMs
Jonas Wallat, Wolfgang Nejdl, Sandipan Sikdar
摘要
Retrieval-augmented generation (RAG) systems require large language models (LLMs) to reconcile discrepancies between their parametric memory-knowledge encoded during training-and contextual inputs provided at inference. When these sources conflict, models often exhibit unstable reasoning and inconsistent factual behavior. We investigate how LLMs resolve such conflicts when the discrepancy arises from temporal misalignment-facts that have changed since the model's knowledge cutoff-and whether mutability, the changeability of facts, can serve as a mediating signal in this process. To do so, we provide WIKIRE-CENTCHANGES, a temporally grounded benchmark with stable and recently updated facts derived from Wikidata. Our results show that while models spontaneously produce temporal reasoning for facts that actually changed -but almost never for stable ones -this differentiation rarely propagates to their final predictions. Explicitly prompting them to consider mutability increases references to temporal change but does not improve factual accuracy, revealing a disconnect between verbalized reasoning and prediction behavior. We further show that the failure point is scale-dependent: smaller models rarely detect the underlying conflict, while larger models detect it but fail to act on their mutability judgments.
问 Lune
尽管问,回答会引用原文。
Lune 会读完全文和相关的 Paper,每个回答都附上所依据的原文段落。
它引用的 Paper22
- Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksPatrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni 等NeurIPS 2020 · 19,162 次引用
- When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric MemoriesAlex Mallen, Akari Asai, Victor Zhong, Rajarshi Das 等ACL 2023 · 233 次引用
- Chain-of-Thought Reasoning In The Wild Is Not Always FaithfulIván Arcuschin, Jett Janiak, Robert Krzyzanowski, Senthooran Rajamanoharan 等ICML 2026 · 175 次引用
- Parameters vs. Context: Fine-Grained Control of Knowledge Reliance in Language ModelsBaolong Bi, Shenghua Liu, Yiwei Wang, Yilong Xu 等ICLR 2026 · 47 次引用
- Context-faithful Prompting for Large Language ModelsWenxuan Zhou, Sheng Zhang, Hoifung Poon, Muhao ChenEMNLP Findings 2023 · 46 次引用
相关 Paper
- RAG or Learning? Understanding the Limits of LLM Adaptation under Continuous Knowledge Drift in the Real WorldHanbing Liu, Lang Cao, Yang LiACL Findings 2026
- Conflict-Aware Soft Prompting for Retrieval-Augmented GenerationEunseong Choi, June Park, Hyeri Lee, Jongwuk LeeEMNLP 2025 · 1 次引用
- Benchmarking Multimodal Knowledge Conflict for Large Multimodal ModelsYifan Jia, Yuntao Du, Kailin Jiang, Yuyang Liang 等AAAI 2026
- HoH: A Dynamic Benchmark for Evaluating the Impact of Outdated Information on Retrieval-Augmented GenerationJie Ouyang, Tingyue Pan, Mingyue Cheng, Ruiran Yan 等ACL 2025 · 14 次引用
- DeFuzzRAG: Handling Fuzzy Time Expressions for Temporal Robustness in Retrieval-Augmented GenerationLing-Chun Chen, Hsi-Wen Chen, Ming-Syan ChenAAAI 2026
