AES: Curing Optimizer Blindness in Long-Tailed Recognition via State-Aware Correction
Fanfu Wang, Jiachang Zhan, Zhiheng Gong, Pengkun Wang, Yang Wang
摘要
Long-tailed recognition fundamentally suffers from optimizer blindness where the optimization process mistakenly conflates the magnitude of gradient accumulation with the scarcity of semantic information. Existing strategies relying on static frequency-based priors fail to correct this bias and result in state blindness regarding supervision and micro-level blindness regarding parameter updates. To address these limitations, we propose the AES framework to establish a dynamic and state-aware correction system across the entire learning lifecycle. We specifically introduce Adaptive Residual Supervision loss to act as a real-time reality check for supervision completeness via precision shielding. We also propose Entropy-aware PCGrad to resolve parameter-level conflicts by quantifying task specificity through gradient entropy. Additionally, we devise Sample-level Conflict Arbitrated Fusion to serve as a dynamic inference arbiter that routes predictions based on instance difficulty. Extensive experiments on CIFAR-100-LT, ImageNet-LT, and iNaturalist 2018 demonstrate that our method consistently achieves state-of-the-art performance by effectively balancing head-class stability and tail-class discrimination. Code is available at here
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper25
- Gradient Surgery for Multi-Task LearningTianhe Yu, Saurabh Kumar, Abhishek Gupta, Sergey Levine 等NeurIPS 2020 · 被引用 2,261 次
- Decoupling Representation and Classifier for Long-Tailed RecognitionBingyi Kang, Saining Xie, Marcus Rohrbach, Zhicheng Yan 等ICLR 2020 · 被引用 1,496 次
- Long-tail learning via logit adjustmentAditya Krishna Menon, Sadeep Jayasumana, Ankit Singh Rawat, Himanshu Jain 等ICLR 2021 · 被引用 937 次
- Balanced Meta-Softmax for Long-Tailed Visual RecognitionJiawei Ren, Cunjun Yu, Shunan Sheng, Xiao Ma 等NeurIPS 2020 · 被引用 861 次
- Which Tasks Should Be Learned Together in Multi-task Learning?Trevor Standley, Amir Zamir, Dawn Chen, Leonidas J. Guibas 等ICML 2020 · 被引用 651 次
相关 Paper
- Confusion-Aware Spectral Regularizer for Long-Tailed RecognitionZiquan Zhu, Gaojie Jin, Hanruo Zhu, Si-Yuan Lu 等CVPR 2026 · 被引用 4 次
- ACE: Ally Complementary Experts for Solving Long-Tailed Recognition in One-ShotJiarui Cai, Yizhou Wang, Jenq-Neng HwangICCV 2021 · 被引用 176 次
- Learning Dynamics as Feedback: An Adaptive Entropy Flow Dynamics Framework for Long-tailed Human Action RecognitionYuan Dong, Zhe Zhao, Liheng Yu, Di Wu 等AAAI 2026
- AdaPrior: Bayesian-Inspired Adaptive Prior Correction for Long-Tailed Continual LearningS Divakar Bhat, Amit Popat More, Mudit Soni, Bhuvan AggarwalCVPR 2026
- GUIDE: Gated Uncertainty-Informed Disentangled Experts for Long-tailed RecognitionYuan Dong, Zhe Zhao, Liheng Yu, Di Wu 等ICLR 2026
