From Expansion to Retraction: Long-tailed Machine Unlearning via Boundary Manipulation
Min Chen, Weizhuo Gao, Chen Wang, Gaoyang Liu, Ahmed M. Abdelmoniem, Kai Peng
Abstract
Machine unlearning aims to remove the information of specific data from a trained machine learning model while retaining its utility for the remaining data, so as to meet the requirements of privacy regulations. Existing unlearning methods often assume a balanced data distribution, but neglect the real-world, long-tailed scenarios, where the decision boundaries of tail classes are frequently distorted due to insufficient sample representation, thereby reducing the unlearning efficacy. In this paper, we propose the first Long-Tailed Machine Unlearning (LTMU) framework from a unified decision-boundary perspective. Our framework begins with a directional boundary repair scheme designed to enrich the distorted decision boundary of the tail class, and then develop a novel boundary retraction approach tailored for long-tailed unlearning, dispersing both the augmented and original features throughout the feature space. This bidirectional manipulation not only offers a unified interpretation of the relationship between long-tailed learning and unlearning, but also enables flexible control over both repair and unlearning processes through the generation of augmented features, thereby effectively accomplishing the long-tailed unlearning task. Extensive experiments across multiple datasets and neural network architectures demonstrate the effectiveness of our framework in achieving complete unlearning of tail classes in long-tailed distributions.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a3e9cede-5e16-4d20-860a-bdd28243112fBuilds on17
- RandAugment: Practical Automated Data Augmentation with a Reduced Search SpaceEkin Dogus Cubuk, Barret Zoph, Jonathon Shlens, Quoc LeNeurIPS 2020 · 4,453 citations
- Certified Data Removal from Machine Learning ModelsChuan Guo, Tom Goldstein, Awni Y. Hannun, Laurens van der MaatenICML 2020 · 633 citations
- Knowledge Distillation from A Stronger TeacherTao Huang, Shan You, Fei Wang, Chen Qian et al.NeurIPS 2022 · 477 citations
- Amnesiac Machine LearningLaura Graves, Vineel Nagisetty, Vijay GaneshAAAI 2021 · 416 citations
- Towards Unbounded Machine UnlearningMeghdad Kurmanji, Peter Triantafillou, Jamie Hayes, Eleni TriantafillouNeurIPS 2023 · 363 citations
Related papers
- FaLW: A Forgetting-aware Loss Reweighting for Long-tailed UnlearningLiheng Yu, Zhe Zhao, Yuxuan Wang, Pengkun Wang et al.ICLR 2026 · 5 citations
- Boundary Unlearning: Rapid Forgetting of Deep Networks via Shifting the Decision BoundaryMin Chen, Weizhuo Gao, Gaoyang Liu, Kai Peng et al.CVPR 2023
- Geometry of Long-Tailed Representation Learning: Rebalancing Features for Skewed DistributionsLingjie Yi, Jiachen Yao, Weimin Lyu, Haibin Ling et al.ICLR 2025
- Decision Boundary-aware Generation for Long-tailed LearningJiacheng Yang, Ruichi Zhang, Chikai Shang, Mengke Li et al.CVPR 2026 · 1 citation
- Feature Fusion from Head to Tail for Long-Tailed Visual RecognitionMengke Li, Zhikai Hu, Yang Lu, Weichao Lan et al.AAAI 2024 · 59 citations
