A Tiny Change, a Giant Leap: Long-Tailed Class-Incremental Learning via Geometric Prototype Alignment
Xinyi Lai, Luojun Lin, Weijie Chen, Yuanlong Yu
摘要
Long-Tailed Class-Incremental Learning (LT-CIL) remains a fundamental challenge due to biased gradient updates caused by highly imbalanced data distributions and the inherent stability-plasticity dilemma. These factors jointly degrade tail-class performance and exacerbate catastrophic forgetting. To tackle these issues, we propose Geometric Prototype Alignment (GPA), a model-agnostic approach that calibrates classifier learning dynamics via geometric feature-space alignment. GPA initializes classifier weights by projecting frozen class prototypes onto a unit hypersphere, thereby disentangling magnitude imbalance from angular discriminability. During incremental updates, a Dynamic Anchoring mechanism adaptively adjusts classifier weights to preserve geometric consistency, effectively balancing plasticity for new classes with stability for previously acquired knowledge. Integrated into state-of-the-art CIL frameworks such as LU-CIR and DualPrompt, GPA yields substantial gains, improving average incremental accuracy by 6.11% and reducing forgetting rates by 6.38% on CIFAR100-LT. Theoretical analysis further demonstrates that GPA accelerates convergence by 2.7× and produces decision boundaries approaching Fisher-optimality. Our implementation is
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper9
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn 等ICLR 2021 · 被引用 21,477 次
- The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution GeneralizationDan Hendrycks, Steven Basart, Norman Mu, Saurav Kadavath 等ICCV 2021 · 被引用 2,294 次
- Fine-Tuning can Distort Pretrained Features and Underperform Out-of-DistributionAnanya Kumar, Aditi Raghunathan, Robbie Matthew Jones, Tengyu Ma 等ICLR 2022 · 被引用 911 次
- Learning to Prompt for Continual LearningZifeng Wang, Zizhao Zhang, Chen-Yu Lee, Han Zhang 等CVPR 2022 · 被引用 635 次
- Long-Tail Class Incremental Learning via Independent SUb-Prototype ConstructionXi Wang, Xu Yang, Jie Yin, Kun Wei 等CVPR 2024 · 被引用 10 次
相关 Paper
- AdaPrior: Bayesian-Inspired Adaptive Prior Correction for Long-Tailed Continual LearningS Divakar Bhat, Amit Popat More, Mudit Soni, Bhuvan AggarwalCVPR 2026
- DGS: Dual Gradient and Semantic-Shift Guided Low-Rank Adaptation for Class Incremental LearningKai Li, Jiafeng Li, Lianghua He, Ying WenCVPR 2026
- Topology-aware Knowledge Preservation for Class-Incremental LearningHan Zang, Yongfeng Dong, Linhao Li, Liang Yang 等AAAI 2026
- Gradient Reweighting: Towards Imbalanced Class-Incremental LearningJiangpeng HeCVPR 2024
- Federated Few-Shot Class-Incremental LearningMuhammad Anwar Ma'sum, Mahardhika Pratama, Lin Liu, Habibullah 等ICLR 2025
