Modality-Decoupled Online Recursive Editing
Siyuan Li, Youyuan Zhang, Fangming Liu, Jing Li
摘要
Online model editing for multimodal large language models (MLLMs) requires assimilating a stream of corrections under tight compute and memory budgets. Yet editors developed for text-only LLMs often degrade on MLLMs: visually dominant activations skew the statistics that shape updates, causing cross-modal conflict , while sequential writes become entangled in a shared edit space and amplify long-horizon interference, causing inter-edit interference . To address these, we propose M-ORE , a modality-decoupled online recursive editor for lifelong MLLM adaptation. M-ORE is derived from a unified proximal-projection formulation and admits a closed-form update with a Sherman-Morrison recursion, yielding constant per-edit overhead. It maintains module-wise locality statistics for the text stack and the visual projector to avoid visually dominated update shaping and performs continual updates in a fixed orthogonal low-rank edit subspace via a Sherman-Morrison recursion to mitigate long-horizon interference. Experiments on multiple MLLM backbones and online editing benchmarks show that our M-ORE method consistently improves reliability, generality, and locality over strong baselines, while achieving favorable quality-efficiency scaling. Our code is publicly available at https://github.com/lab-klc/M-ORE.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper29
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language ModelsJunnan Li, Dongxu Li, Silvio Savarese, Steven C. H. HoiICML 2023 · 被引用 7,873 次
- Locating and Editing Factual Associations in GPTKevin Meng, David Bau, Alex Andonian, Yonatan BelinkovNeurIPS 2022 · 被引用 3,415 次
- Fast Model Editing at ScaleEric Mitchell, Charles Lin, Antoine Bosselut, Chelsea Finn 等ICLR 2022 · 被引用 527 次
- Memory-Based Model Editing at ScaleEric Mitchell, Charles Lin, Antoine Bosselut, Christopher D. Manning 等ICML 2022 · 被引用 520 次
相关 Paper
- Towards Lifelong Model Editing via Simulating Ideal EditorYaming Guo, Siyang Guo, Hengshu Zhu, Ying SunICML 2025
- MemEIC: A Step Toward Continual and Compositional Knowledge EditingJin Seong, Jiyun Park, Wencke Liermann, Hongseok Choi 等NeurIPS 2025 · 被引用 2 次
- Dynamic Mixture of Curriculum LoRA Experts for Continual Multimodal Instruction TuningChendi Ge, Xin Wang, Zeyang Zhang, Hong Chen 等ICML 2025
- MicroEdit: Neuron-level Knowledge Disentanglement and Localization in Lifelong Model EditingShiqi Wang, Qi Wang, Runliang Niu, He Kong 等EMNLP 2025 · 被引用 1 次
- LEMoE: Advanced Mixture of Experts Adaptor for Lifelong Model Editing of Large Language ModelsRenzhi Wang, Piji LiEMNLP 2024 · 被引用 3 次
