Lune

EMNLP2024Top-tier venue

EVEDIT: Event-based Knowledge Editing for Deterministic Knowledge Propagation

Jiateng Liu, Pengfei Yu, Yuji Zhang, Sha Li, Zixuan Zhang, Ruhi Sarikaya, Kevin Small, Heng Ji

Abstract

The dynamic nature of real-world information necessitates knowledge editing (KE) in large language models (LLMs).This edited knowledge should propagate and facilitate the deduction of new information based on existing model knowledge.We define the existing related knowledge in a LLM serving as the origination of knowledge propagation as "deduction anchors".However, most of current KE approaches only operate on (subject, relation, object) triples.Both theoretically and empirically, we observe that this simplified setting often leads to uncertainty when determining the deduction anchors, causing low confidence in their responses.To mitigate this issue, we propose a novel task of event-based knowledge editing that pairs facts with event descriptions.This task manifests both as a closer simulation of real-world editing scenarios and a more logically sound setting, implicitly defining the deduction anchor and enabling LLMs to propagate knowledge confidently.We curate a new benchmark dataset EVEDIT derived from the COUNTERFACT dataset and validate its superiority in improving model confidence.Moreover, as we observe that the event-based setting is notably challenging for existing approaches, we propose a novel approach Self-Edit that showcases stronger performance, achieving 55.6% consistency improvement while maintaining the naturalness of generation. 1 * These authors contribute to this work equally. 1 We will release the benchmark and code.Implicitly define the deduction anchor, ensuring model certainty.Previous Simple edits: Messi is a Dutch citizen.In 2024, Lionel Messi made the decision to move to Netherlands and applied for Dutch citizenship.After necessary procedures, he was granted Dutch citizenship and became a citizen of Netherlands.Q: Is Messi a citizen of Argentina in 2023?Q:Where was Messi born ?Q: Did Messi won the World Cup in 2022 ?Ignore the deduction anchor, leading to model uncertainty.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

3 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • GeoEdit: Geometric Knowledge Editing for Large Language Models cites LoRA: Low-Rank Adaptation of Large Language Models
  • ChainEdit: Propagating Ripple Effects in LLM Knowledge Editing through Logical Rule-Guided Chains cites LoRA: Low-Rank Adaptation of Large Language Models
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers3

  1. Editing the Moving World: Model Editing for Video LLMsQian Zhang, Xinye Li, Xiaokai Wu, Junhao Xu et al.ACL 2026
  2. GeoEdit: Geometric Knowledge Editing for Large Language ModelsYujie Feng, Li-Ming Zhan, Zexin Lu, Yongxin Xu et al.EMNLP 2025
  3. ChainEdit: Propagating Ripple Effects in LLM Knowledge Editing through Logical Rule-Guided ChainsZilu Dong, Xiangqing Shen, Zinong Yang, Rui XiaACL 2025

Builds on23

  1. LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations
  2. Toolformer: Language Models Can Teach Themselves to Use ToolsTimo Schick, Jane Dwivedi-Yu, Roberto Dessì, Roberta Raileanu et al.NeurIPS 2023 · 5,989 citations
  3. Self-RAG: Learning to Retrieve, Generate, and Critique through Self-ReflectionAkari Asai, Zeqiu Wu, Yizhong Wang, Avirup Sil et al.ICLR 2024 · 1,798 citations
  4. Generalization through Memorization: Nearest Neighbor Language ModelsUrvashi Khandelwal, Omer Levy, Dan Jurafsky, Luke Zettlemoyer et al.ICLR 2020 · 1,038 citations
  5. ViperGPT: Visual Inference via Python Execution for ReasoningDídac Surís, Sachit Menon, Carl VondrickICCV 2023 · 732 citations

Related papers

  1. AKEW: Assessing Knowledge Editing in the WildXiaobao Wu, Liangming Pan, William Yang Wang, Anh Tuan LuuEMNLP 2024 · 2 citations
  2. MMKE-Bench: A Multimodal Editing Benchmark for Diverse Visual KnowledgeYuntao Du, Kailin Jiang, Zhi Gao, Chenrui Shi et al.ICLR 2025
  3. ScEdit: Script-based Assessment of Knowledge EditingXinye Li, Zunwen Zheng, Qian Zhang, Dekai Zhuang et al.ACL Findings 2025
  4. RelEdit: Evaluating Conceptual Knowledge Editing in Language Models via Relational ReasoningYifan Niu, Miao Peng, Nuo Chen, Yatao Bian et al.ACL Findings 2025
  5. Editing Conceptual Knowledge for Large Language ModelsXiaohan Wang, Shengyu Mao, Shumin Deng, Yunzhi Yao et al.EMNLP Findings 2024 · 9 citations
Dusk over the sea between two cliffs drawn in fine vertical lines