Improving Calibration for Long-Tailed Recognition
Zhisheng Zhong, Jiequan Cui, Shu Liu, Jiaya Jia
Abstract
Deep neural networks may perform poorly when training datasets are heavily class-imbalanced. Recently, twostage methods decouple representation learning and classifier learning to improve performance. But there is still the vital issue of miscalibration. To address it, we design two methods to improve calibration and performance in such scenarios. Motivated by the fact that predicted probability distributions of classes are highly related to the numbers of class instances, we propose label-aware smoothing to deal with different degrees of over-confidence for classes and improve classifier learning. For dataset bias between these two stages due to different samplers, we further propose shifted batch normalization in the decoupling framework. Our proposed methods set new records on multiple popular long-tailed recognition benchmark datasets, including
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a205e9c2-ebfa-4cf8-aca1-133ec981fb62Cited by top-tier papers113
- Parametric Contrastive LearningJiequan Cui, Zhisheng Zhong, Shu Liu, Bei Yu et al.ICCV 2021 · 375 citations
- Self-Supervised Aggregation of Diverse Experts for Test-Agnostic Long-Tailed RecognitionYifan Zhang, Bryan Hooi, Lanqing Hong, Jiashi FengNeurIPS 2022 · 214 citations
- The Majority Can Help the Minority: Context-rich Minority Oversampling for Long-tailed ClassificationSeulki Park, Youngkyu Hong, Byeongho Heo, Sangdoo Yun et al.CVPR 2022 · 199 citations
- Inducing Neural Collapse in Imbalanced Learning: Do We Really Need a Learnable Classifier at the End of Deep Neural Network?Yibo Yang, Shixiang Chen, Xiangtai Li, Liang Xie et al.NeurIPS 2022 · 144 citations
- Nested Collaborative Learning for Long-Tailed Visual RecognitionJun Li, Zichang Tan, Jun Wan, Zhen Lei et al.CVPR 2022 · 95 citations
Builds on4
- CutMix: Regularization Strategy to Train Strong Classifiers With Localizable FeaturesSangdoo Yun, Dongyoon Han, Sanghyuk Chun, Seong Joon Oh et al.ICCV 2019 · 5,843 citations
- Decoupling Representation and Classifier for Long-Tailed RecognitionBingyi Kang, Saining Xie, Marcus Rohrbach, Zhicheng Yan et al.ICLR 2020 · 1,496 citations
- Calibrating Deep Neural Networks using Focal LossJishnu Mukhoti, Viveka Kulharia, Amartya Sanyal, Stuart Golodetz et al.NeurIPS 2020 · 674 citations
- BBN: Bilateral-Branch Network With Cumulative Learning for Long-Tailed Visual RecognitionBoyan Zhou, Quan Cui, Xiu-Shen Wei, Zhao-Min ChenCVPR 2020
Related papers
- Rethinking Classifier Re-Training in Long-Tailed Recognition: Label Over-Smooth Can BalanceSiyu Sun, Han Lu, Jiangtong Li, Yichen Xie et al.ICLR 2025
- Distribution Alignment: A Unified Framework for Long-Tail Visual RecognitionSongyang Zhang, Zeming Li, Shipeng Yan, Xuming He et al.CVPR 2021
- Class Adaptive Network CalibrationBingyuan Liu, Jérôme Rony, Adrian Galdran, Jose Dolz et al.CVPR 2023
- Why Not Hyperparameter-Friendly Optimisation? A Monotonic Adaptive Norm Rescaling Approach For Long-Tailed RecognitionShuo Zhang, Chenqi Li, Tingting ZhuCVPR 2026
- Class-Conditional Sharpness-Aware Minimization for Deep Long-Tailed RecognitionZhipeng Zhou, Lanqing Li, Peilin Zhao, Pheng-Ann Heng et al.CVPR 2023
