LOTUS: Evolving Multimodal Unlearning via Hyperbolic Entailment and Lorentz Transport
Zekun Wang, Jingjie Zeng, Yingxu Li, Hongfei Lin, Liang Yang
Abstract
Multimodal Large Language Models (MLLMs) face critical privacy challenges arising from the indiscriminate memorization of sensitive data. Existing unlearning methods often fail to precisely disentangle specific instances from general concepts, leading to either catastrophic forgetting of useful knowledge or unsafe content substitution. We attribute these failures to a fundamental geometric mismatch: these approaches primarily operate in Euclidean space, which lacks the capacity to model the hierarchical entailment inherent in visual-linguistic concepts. To address this, we introduce LOTUS (LOrentz Transport for Unlearning Strategies), a framework that performs surgical semantic pruning within the Lorentz manifold. LOTUS employs an Inverted Entailment Cone Loss to sever the semantic inheritance of sensitive concepts and a Lorentz Transport mechanism to align pruned features with a safety refusal prior in the tangent space. Extensive experiments on MLLMU-Bench demonstrate that LOTUS significantly outperforms baselines, improving unlearning efficacy by over 9% on LLaVA compared to state-of-the-art constraint-based methods. Crucially, LOTUS achieves this precision while maintaining general utility, effectively resolving the dilemma between thorough erasure and model stability.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e4de61e5-97ec-440a-8ade-a1bc12871152Builds on10
- The WMDP Benchmark: Measuring and Reducing Malicious Use with UnlearningNathaniel Li, Alexander Pan, Anjali Gopal, Summer Yue et al.ICML 2024 · 390 citations
- Variational Bayesian UnlearningQuoc Phong Nguyen, Bryan Kian Hsiang Low, Patrick JailletNeurIPS 2020 · 198 citations
- Hyperbolic Image-text RepresentationsKaran Desai, Maximilian Nickel, Tanmay Rajpurohit, Justin Johnson et al.ICML 2023 · 137 citations
- Editing models with task arithmeticGabriel Ilharco, Marco Túlio Ribeiro, Mitchell Wortsman, Ludwig Schmidt et al.ICLR 2023 · 31 citations
- DEPN: Detecting and Editing Privacy Neurons in Pretrained Language ModelsXinwei Wu, Junzhuo Li, Minghui Xu, Weilong Dong et al.EMNLP 2023 · 28 citations
Related papers
- Modality-Aware Neuron Pruning for Unlearning in Multimodal Large Language ModelsZheyuan Liu, Guangyao Dou, Xiangchi Yuan, Chunhui Zhang et al.ACL 2025
- Constrained Entropic Unlearning: A Primal-Dual Framework for Large Language ModelsTaha Entesari, Arman Hatami, Rinat Khaziev, Anil Ramakrishna et al.NeurIPS 2025 · 12 citations
- VL-Eraser: Vacuum Distillation for Machine Unlearning in Vision-Language ModelsYili Wang, Lu Dai, Tairan Huang, Yijie Xu et al.CVPR 2026
- Towards Robust and Parameter-Efficient Knowledge Unlearning for LLMsSungmin Cha, Sungjun Cho, Dasol Hwang, Moontae LeeICLR 2025
- Unified Parameter-Efficient Unlearning for LLMsChenlu Ding, Jiancan Wu, Yancheng Yuan, Jinda Lu et al.ICLR 2025
