A Tiny Change, a Giant Leap: Long-Tailed Class-Incremental Learning via Geometric Prototype Alignment
Xinyi Lai, Luojun Lin, Weijie Chen, Yuanlong Yu
Abstract
Long-Tailed Class-Incremental Learning (LT-CIL) remains a fundamental challenge due to biased gradient updates caused by highly imbalanced data distributions and the inherent stability-plasticity dilemma. These factors jointly degrade tail-class performance and exacerbate catastrophic forgetting. To tackle these issues, we propose Geometric Prototype Alignment (GPA), a model-agnostic approach that calibrates classifier learning dynamics via geometric feature-space alignment. GPA initializes classifier weights by projecting frozen class prototypes onto a unit hypersphere, thereby disentangling magnitude imbalance from angular discriminability. During incremental updates, a Dynamic Anchoring mechanism adaptively adjusts classifier weights to preserve geometric consistency, effectively balancing plasticity for new classes with stability for previously acquired knowledge. Integrated into state-of-the-art CIL frameworks such as LU-CIR and DualPrompt, GPA yields substantial gains, improving average incremental accuracy by 6.11% and reducing forgetting rates by 6.38% on CIFAR100-LT. Theoretical analysis further demonstrates that GPA accelerates convergence by 2.7× and produces decision boundaries approaching Fisher-optimality. Our implementation is
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 2d5417e6-dc11-416b-ba0a-5f7e852fd13fBuilds on9
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution GeneralizationDan Hendrycks, Steven Basart, Norman Mu, Saurav Kadavath et al.ICCV 2021 · 2,294 citations
- Fine-Tuning can Distort Pretrained Features and Underperform Out-of-DistributionAnanya Kumar, Aditi Raghunathan, Robbie Matthew Jones, Tengyu Ma et al.ICLR 2022 · 911 citations
- Learning to Prompt for Continual LearningZifeng Wang, Zizhao Zhang, Chen-Yu Lee, Han Zhang et al.CVPR 2022 · 635 citations
- Long-Tail Class Incremental Learning via Independent SUb-Prototype ConstructionXi Wang, Xu Yang, Jie Yin, Kun Wei et al.CVPR 2024 · 10 citations
Related papers
- AdaPrior: Bayesian-Inspired Adaptive Prior Correction for Long-Tailed Continual LearningS Divakar Bhat, Amit Popat More, Mudit Soni, Bhuvan AggarwalCVPR 2026
- DGS: Dual Gradient and Semantic-Shift Guided Low-Rank Adaptation for Class Incremental LearningKai Li, Jiafeng Li, Lianghua He, Ying WenCVPR 2026
- Topology-aware Knowledge Preservation for Class-Incremental LearningHan Zang, Yongfeng Dong, Linhao Li, Liang Yang et al.AAAI 2026
- Gradient Reweighting: Towards Imbalanced Class-Incremental LearningJiangpeng HeCVPR 2024
- Federated Few-Shot Class-Incremental LearningMuhammad Anwar Ma'sum, Mahardhika Pratama, Lin Liu, Habibullah et al.ICLR 2025
