ACL Findings2025
A Survey on Proactive Defense Strategies Against Misinformation in Large Language Models
Shuliang Liu, Hongyi Liu, Aiwei Liu, Bingchen Duan, Zheng Qi, Yibo Yan, He Geng, Peijie Jiang, Jia Liu, Xuming Hu
Abstract
The widespread deployment of large language models (LLMs) across critical domains has amplified the societal risks posed by algorithmically generated misinformation. Unlike traditional false content, LLM-generated misinformation can be self-reinforcing, highly plausible, and capable of rapid propagation across multiple languages, which traditional detection methods fail to mitigate effectively. This paper introduces a proactive defense paradigm, shifting from passive post hoc detection to anticipatory mitigation strategies. We propose a Three Pillars framework: (1) Knowledge Credibility, fortifying the integrity of training and deployed data; (2) Inference Reliability, embedding selfcorrective mechanisms during reasoning; and
(3) Input Robustness, enhancing the resilience of model interfaces against adversarial attacks. Through a comprehensive survey of existing techniques and a comparative meta-analysis, we demonstrate that proactive defense strategies offer up to 63% improvement over conventional methods in misinformation prevention, despite non-trivial computational overhead and generalization challenges. We argue that future research should focus on co-designing robust knowledge foundations, reasoning certification, and attack-resistant interfaces to ensure LLMs can effectively counter misinformation across varied domains.
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Lune answers from
the full paper · 2 top-tier papers that cite it · related work
Free to start. No credit card required.
Cited by top-tier papers2
- Distilling the Thought, Watermarking the Answer: A Principle Semantic Guided Watermark for Reasoning Large Language ModelsShuliang Liu, Xingyu Li, Hongyi Liu, Dong Fang et al.ICLR 2026 · 2 citations
- VLA-Mark: A cross modal watermark for large vision-language alignment modelsShuliang Liu, Zheng Qi, Jesse Jiaxi Xu, Yibo Yan et al.EMNLP 2025
Builds on26
- Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksPatrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni et al.NeurIPS 2020 · 19,162 citations
- TruthfulQA: Measuring How Models Mimic Human FalsehoodsStephanie Lin, Jacob Hilton, Owain EvansACL 2022 · 3,228 citations
- Retrieval Augmented Language Model Pre-TrainingKelvin Guu, Kenton Lee, Zora Tung, Panupong Pasupat et al.ICML 2020 · 2,937 citations
- Self-Instruct: Aligning Language Models with Self-Generated InstructionsYizhong Wang, Yeganeh Kordi, Swaroop Mishra, Alisa Liu et al.ACL 2023 · 540 citations
- Memory-Based Model Editing at ScaleEric Mitchell, Charles Lin, Antoine Bosselut, Christopher D. Manning et al.ICML 2022 · 520 citations
Related papers
- On the Risk of Misinformation Pollution with Large Language ModelsYikang Pan, Liangming Pan, Wenhu Chen, Preslav Nakov et al.EMNLP Findings 2023 · 85 citations
- Large Language Model (LLM)-driven Adversarial Social Influences in Online Information Spread: Risks and InterventionsZhuoran Lu, Gionnieve Lim, Ming YinCHI 2026
- Unraveling Misinformation Propagation in LLM ReasoningYiyang Feng, Yichen Wang, Shaobo Cui, Boi Faltings et al.EMNLP Findings 2025
- Chaos with Keywords: Exposing Large Language Models Sycophancy to Misleading Keywords and Evaluating Defense StrategiesAswin RRV, Nemika Tyagi, Md Nayem Uddin, Neeraj Varshney et al.ACL Findings 2024 · 13 citations
- Learn and Unlearn: Addressing Misinformation in Multilingual LLMsTaiming Lu, Philipp KoehnEMNLP 2025
