AES: Curing Optimizer Blindness in Long-Tailed Recognition via State-Aware Correction
Fanfu Wang, Jiachang Zhan, Zhiheng Gong, Pengkun Wang, Yang Wang
Abstract
Long-tailed recognition fundamentally suffers from optimizer blindness where the optimization process mistakenly conflates the magnitude of gradient accumulation with the scarcity of semantic information. Existing strategies relying on static frequency-based priors fail to correct this bias and result in state blindness regarding supervision and micro-level blindness regarding parameter updates. To address these limitations, we propose the AES framework to establish a dynamic and state-aware correction system across the entire learning lifecycle. We specifically introduce Adaptive Residual Supervision loss to act as a real-time reality check for supervision completeness via precision shielding. We also propose Entropy-aware PCGrad to resolve parameter-level conflicts by quantifying task specificity through gradient entropy. Additionally, we devise Sample-level Conflict Arbitrated Fusion to serve as a dynamic inference arbiter that routes predictions based on instance difficulty. Extensive experiments on CIFAR-100-LT, ImageNet-LT, and iNaturalist 2018 demonstrate that our method consistently achieves state-of-the-art performance by effectively balancing head-class stability and tail-class discrimination. Code is available at here
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext c2cfe7e2-47ee-4c5f-8442-2b1a053eff56Builds on25
- Gradient Surgery for Multi-Task LearningTianhe Yu, Saurabh Kumar, Abhishek Gupta, Sergey Levine et al.NeurIPS 2020 · 2,261 citations
- Decoupling Representation and Classifier for Long-Tailed RecognitionBingyi Kang, Saining Xie, Marcus Rohrbach, Zhicheng Yan et al.ICLR 2020 · 1,496 citations
- Long-tail learning via logit adjustmentAditya Krishna Menon, Sadeep Jayasumana, Ankit Singh Rawat, Himanshu Jain et al.ICLR 2021 · 937 citations
- Balanced Meta-Softmax for Long-Tailed Visual RecognitionJiawei Ren, Cunjun Yu, Shunan Sheng, Xiao Ma et al.NeurIPS 2020 · 861 citations
- Which Tasks Should Be Learned Together in Multi-task Learning?Trevor Standley, Amir Zamir, Dawn Chen, Leonidas J. Guibas et al.ICML 2020 · 651 citations
Related papers
- Confusion-Aware Spectral Regularizer for Long-Tailed RecognitionZiquan Zhu, Gaojie Jin, Hanruo Zhu, Si-Yuan Lu et al.CVPR 2026 · 4 citations
- ACE: Ally Complementary Experts for Solving Long-Tailed Recognition in One-ShotJiarui Cai, Yizhou Wang, Jenq-Neng HwangICCV 2021 · 176 citations
- Learning Dynamics as Feedback: An Adaptive Entropy Flow Dynamics Framework for Long-tailed Human Action RecognitionYuan Dong, Zhe Zhao, Liheng Yu, Di Wu et al.AAAI 2026
- AdaPrior: Bayesian-Inspired Adaptive Prior Correction for Long-Tailed Continual LearningS Divakar Bhat, Amit Popat More, Mudit Soni, Bhuvan AggarwalCVPR 2026
- GUIDE: Gated Uncertainty-Informed Disentangled Experts for Long-tailed RecognitionYuan Dong, Zhe Zhao, Liheng Yu, Di Wu et al.ICLR 2026
