Lune

ACL Findings2026

When Facts Change: Temporal Knowledge Conflict Resolution in LLMs

Jonas Wallat, Wolfgang Nejdl, Sandipan Sikdar

Abstract

Retrieval-augmented generation (RAG) systems require large language models (LLMs) to reconcile discrepancies between their parametric memory-knowledge encoded during training-and contextual inputs provided at inference. When these sources conflict, models often exhibit unstable reasoning and inconsistent factual behavior. We investigate how LLMs resolve such conflicts when the discrepancy arises from temporal misalignment-facts that have changed since the model's knowledge cutoff-and whether mutability, the changeability of facts, can serve as a mediating signal in this process. To do so, we provide WIKIRE-CENTCHANGES, a temporally grounded benchmark with stable and recently updated facts derived from Wikidata. Our results show that while models spontaneously produce temporal reasoning for facts that actually changed -but almost never for stable ones -this differentiation rarely propagates to their final predictions. Explicitly prompting them to consider mutability increases references to temporal change but does not improve factual accuracy, revealing a disconnect between verbalized reasoning and prediction behavior. We further show that the failure point is scale-dependent: smaller models rarely detect the underlying conflict, while larger models detect it but fail to act on their mutability judgments.

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · related work

Get the answer

Free to start. No credit card required.

Builds on22

  1. Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksPatrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni et al.NeurIPS 2020 · 19,162 citations
  2. When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric MemoriesAlex Mallen, Akari Asai, Victor Zhong, Rajarshi Das et al.ACL 2023 · 233 citations
  3. Chain-of-Thought Reasoning In The Wild Is Not Always FaithfulIván Arcuschin, Jett Janiak, Robert Krzyzanowski, Senthooran Rajamanoharan et al.ICML 2026 · 175 citations
  4. Parameters vs. Context: Fine-Grained Control of Knowledge Reliance in Language ModelsBaolong Bi, Shenghua Liu, Yiwei Wang, Yilong Xu et al.ICLR 2026 · 47 citations
  5. Context-faithful Prompting for Large Language ModelsWenxuan Zhou, Sheng Zhang, Hoifung Poon, Muhao ChenEMNLP Findings 2023 · 46 citations

Related papers

  1. RAG or Learning? Understanding the Limits of LLM Adaptation under Continuous Knowledge Drift in the Real WorldHanbing Liu, Lang Cao, Yang LiACL Findings 2026
  2. Conflict-Aware Soft Prompting for Retrieval-Augmented GenerationEunseong Choi, June Park, Hyeri Lee, Jongwuk LeeEMNLP 2025 · 1 citation
  3. Benchmarking Multimodal Knowledge Conflict for Large Multimodal ModelsYifan Jia, Yuntao Du, Kailin Jiang, Yuyang Liang et al.AAAI 2026
  4. HoH: A Dynamic Benchmark for Evaluating the Impact of Outdated Information on Retrieval-Augmented GenerationJie Ouyang, Tingyue Pan, Mingyue Cheng, Ruiran Yan et al.ACL 2025 · 14 citations
  5. DeFuzzRAG: Handling Fuzzy Time Expressions for Temporal Robustness in Retrieval-Augmented GenerationLing-Chun Chen, Hsi-Wen Chen, Ming-Syan ChenAAAI 2026
Dusk over the sea between two cliffs drawn in fine vertical lines