ASRU: Activation Steering Meets Reinforcement Unlearning for Multimodal Large Language Models
Jiahui Guang, Haiyan Wang, Yingjie Zhu, Cuiyun Gao, Jing Li, Di Shao, Zhaoquan Gu
摘要
Multimodal large language models (MLLMs) may memorize sensitive cross-modal information during pretraining, making machine unlearning (MU) crucial. Existing methods typically evaluate unlearning effectiveness based on output deviations, while overlooking the generation quality after unlearning. This can easily lead to hallucinated or rigid responses, thereby affecting the usability and safety of the unlearned model. To address this issue, we propose ASRU, a controllable multimodal unlearning framework that incorporates generation quality as a core evaluation objective. ASRU first induces initial refusal behavior through activation redirection, and then optimizes fine-grained refusal boundaries using a customized reward function, thereby achieving a better trade-off between target knowledge unlearning and model utility. Experiments on Qwen3-VL show that ASRU significantly improves unlearning effectiveness (+24.6%) on average and generation quality (5.8×) on average while effectively preserving model utility, using only a small amount of retained supervision data. The code for ASRU is released at https://github.com/guangjh/ASRU .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper14
- Direct Preference Optimization: Your Language Model is Secretly a Reward ModelRafael Rafailov, Archit Sharma, Eric Mitchell, Christopher D. Manning 等NeurIPS 2023 · 被引用 10,924 次
- Safe RLHF: Safe Reinforcement Learning from Human FeedbackJosef Dai, Xuehai Pan, Ruiyang Sun, Jiaming Ji 等ICLR 2024 · 被引用 656 次
- The Linear Representation Hypothesis and the Geometry of Large Language ModelsKiho Park, Yo Joong Choe, Victor VeitchICML 2024 · 被引用 461 次
- Single Image Unlearning: Efficient Machine Unlearning in Multimodal Large Language ModelsJiaqi Li, Qianshan Wei, Chuanyi Zhang, Guilin Qi 等NeurIPS 2024 · 被引用 62 次
- Representation Surgery: Theory and Practice of Affine SteeringShashwat Singh, Shauli Ravfogel, Jonathan Herzig, Roee Aharoni 等ICML 2024 · 被引用 36 次
相关 Paper
- Reinforcement UnlearningDayong Ye, Tianqing Zhu, Congcong Zhu, Derui Wang 等NDSS 2025
- Wisdom is Knowing What not to Say: Hallucination-Free LLMs Unlearning via Attention ShiftingChenchen Tan, Youyang Qu, Xinghao Li, Hui Zhang 等NeurIPS 2025 · 被引用 7 次
- RULE: Reinforcement UnLEarning Achieves Forget-retain Pareto OptimalityChenlong Zhang, Zhuoran Jin, Hongbang Yuan, Jiaheng Wei 等NeurIPS 2025 · 被引用 15 次
- Modality-Aware Neuron Pruning for Unlearning in Multimodal Large Language ModelsZheyuan Liu, Guangyao Dou, Xiangchi Yuan, Chunhui Zhang 等ACL 2025
- Forget to Know, Remember to Use: Context-Aware Unlearning for Large Language ModelsYuefeng Peng, Parnian Afshar, Megan Ganji, Thomas Butler 等ICML 2026 · 被引用 1 次
