CoSSL: Co-Learning of Representation and Classifier for Imbalanced Semi-Supervised Learning
Yue Fan, Dengxin Dai, Anna Kukleva, Bernt Schiele
Abstract
Standard semi-supervised learning (SSL) using classbalanced datasets has shown great progress to leverage unlabeled data effectively. However, the more realistic setting of class-imbalanced data -called imbalanced SSLis largely underexplored and standard SSL tends to underperform. In this paper, we propose a novel co-learning framework (CoSSL), which decouples representation and classifier learning while coupling them closely. To handle the data imbalance, we devise Tail-class Feature Enhancement (TFE) for classifier learning. Furthermore, the current evaluation protocol for imbalanced SSL focuses only on balanced test sets, which has limited practicality in realworld scenarios. Therefore, we further conduct a comprehensive evaluation under various shifted test distributions. In experiments, we show that our approach outperforms other methods over a large range of shifted distributions, achieving state-of-the-art performance on benchmark datasets ranging from CIFAR-10, CIFAR-100, ImageNet, to Food-101. Code is available at https://github. com/YUE-FAN/CoSSL.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers24
- FreeMatch: Self-adaptive Thresholding for Semi-supervised LearningYidong Wang, Hao Chen, Qiang Heng, Wenxin Hou et al.ICLR 2023 · 139 citations
- Towards Generic Semi-Supervised Framework for Volumetric Medical Image SegmentationHaonan Wang, Xiaomeng LiNeurIPS 2023 · 75 citations
- Shrinking Class Space for Enhanced Certainty in Semi-Supervised LearningLihe Yang, Zhen Zhao, Lei Qi, Yu Qiao et al.ICCV 2023 · 27 citations
- Discover and Align Taxonomic Context Priors for Open-world Semi-Supervised LearningYu Wang, Zhun Zhong, Pengchong Qiao, Xuxin Cheng et al.NeurIPS 2023 · 25 citations
- BaCon: Boosting Imbalanced Semi-supervised Learning via Balanced Feature-Level Contrastive LearningQianhan Feng, Lujing Xie, Shijie Fang, Tong LinAAAI 2024 · 20 citations
Builds on15
- FixMatch: Simplifying Semi-Supervised Learning with Consistency and ConfidenceKihyuk Sohn, David Berthelot, Nicholas Carlini, Zizhao Zhang et al.NeurIPS 2020 · 5,129 citations
- RandAugment: Practical Automated Data Augmentation with a Reduced Search SpaceEkin Dogus Cubuk, Barret Zoph, Jonathon Shlens, Quoc LeNeurIPS 2020 · 4,453 citations
- Unsupervised Data Augmentation for Consistency TrainingQizhe Xie, Zihang Dai, Eduard H. Hovy, Thang Luong et al.NeurIPS 2020 · 2,774 citations
- Decoupling Representation and Classifier for Long-Tailed RecognitionBingyi Kang, Saining Xie, Marcus Rohrbach, Zhicheng Yan et al.ICLR 2020 · 1,496 citations
- Long-tail learning via logit adjustmentAditya Krishna Menon, Sadeep Jayasumana, Ankit Singh Rawat, Himanshu Jain et al.ICLR 2021 · 937 citations
Related papers
- DASO: Distribution-Aware Semantics-Oriented Pseudo-label for Imbalanced Semi-Supervised LearningYoungtaek Oh, Dong-Jin Kim, In So KweonCVPR 2022 · 80 citations
- ABC: Auxiliary Balanced Classifier for Class-imbalanced Semi-supervised LearningHyuck Lee, Seungjae Shin, Heeyoung KimNeurIPS 2021 · 131 citations
- SeMi: When Imbalanced Semi-Supervised Learning Meets Mining Hard ExamplesYin Wang, Zixuan Wang, Hao Lu, Zhen Qin et al.ACM MM 2025
- Self-supervised Learning is More Robust to Dataset ImbalanceHong Liu, Jeff Z. HaoChen, Adrien Gaidon, Tengyu MaICLR 2022 · 190 citations
- Three Heads Are Better than One: Complementary Experts for Long-Tailed Semi-supervised LearningChengcheng Ma, Ismail Elezi, Jiankang Deng, Weiming Dong et al.AAAI 2024 · 20 citations
