Long-Tailed Partial Label Learning via Dynamic Rebalancing
Feng Hong, Jiangchao Yao, Zhihan Zhou, Ya Zhang, Yanfeng Wang
Abstract
Real-world data usually couples the label ambiguity and heavy imbalance, challenging the algorithmic robustness of partial label learning (PLL) and long-tailed learning (LT). The straightforward combination of LT and PLL, i.e., LT-PLL, suffers from a fundamental dilemma: LT methods build upon a given class distribution that is unavailable in PLL, and the performance of PLL is severely influenced in long-tailed context. We show that even with the auxiliary of an oracle class prior, the state-of-the-art methods underperform due to an adverse fact that the constant rebalancing in LT is harsh to the label disambiguation in PLL. To overcome this challenge, we thus propose a dynamic rebalancing method, termed as RECORDS, without assuming any prior knowledge about the class distribution. Based on a parametric decomposition of the biased output, our method constructs a dynamic adjustment that is benign to the label disambiguation process and theoretically converges to the oracle class prior. Extensive experiments on three benchmark datasets demonstrate the significant gain of RECORDS compared with a range of baselines. The code is publicly available.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext fffc9188-a8fd-480e-9172-2a8abb2d5889Cited by top-tier papers24
- Locally Estimated Global Perturbations are Better than Local Perturbations for Federated Sharpness-aware MinimizationZiqing Fan, Shengchao Hu, Jiangchao Yao, Gang Niu et al.ICML 2024 · 35 citations
- Out-of-Distribution Detection in Long-Tailed Recognition with Calibrated Outlier Class LearningWenjun Miao, Guansong Pang, Xiao Bai, Tianqi Li et al.AAAI 2024 · 31 citations
- Long-Tailed Partial Label Learning by Head Classifier and Tail Classifier CooperationYuheng Jia, Xiaorui Peng, Ran Wang, Min-Ling ZhangAAAI 2024 · 21 citations
- Combating Representation Learning Disparity with Geometric HarmonizationZhihan Zhou, Jiangchao Yao, Feng Hong, Ya Zhang et al.NeurIPS 2023 · 20 citations
- Revive Re-weighting in Imbalanced Learning by Density Ratio EstimationJiaan Luo, Feng Hong, Jiangchao Yao, Bo Han et al.NeurIPS 2024 · 16 citations
Builds on21
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- RandAugment: Practical Automated Data Augmentation with a Reduced Search SpaceEkin Dogus Cubuk, Barret Zoph, Jonathon Shlens, Quoc LeNeurIPS 2020 · 4,453 citations
- Decoupling Representation and Classifier for Long-Tailed RecognitionBingyi Kang, Saining Xie, Marcus Rohrbach, Zhicheng Yan et al.ICLR 2020 · 1,496 citations
- Long-tail learning via logit adjustmentAditya Krishna Menon, Sadeep Jayasumana, Ankit Singh Rawat, Himanshu Jain et al.ICLR 2021 · 937 citations
- Balanced Meta-Softmax for Long-Tailed Visual RecognitionJiawei Ren, Cunjun Yu, Shunan Sheng, Xiao Ma et al.NeurIPS 2020 · 861 citations
Related papers
- SoLar: Sinkhorn Label Refinery for Imbalanced Partial-Label LearningHaobo Wang, Mingxuan Xia, Yixuan Li, Yuren Mao et al.NeurIPS 2022 · 54 citations
- Robust Logit Adjustment for Learning with Long-Tailed Noisy DataMingcai Chen, Yuntao Du, Wenyu Jiang, Baoming Zhang et al.AAAI 2025 · 4 citations
- Rethinking the Value of Labels for Improving Class-Imbalanced LearningYuzhe Yang, Zhi XuNeurIPS 2020 · 512 citations
- Class-Prior Perturbation-Robust Regularization for Imbalanced Unreliable Partial Label LearningCongyu Qiao, Haohao Dong, Xin Geng, Ning XuICML 2026
- Unlocker: Disentangle the Deadlock of Learning between Label-noisy and Long-tailed DataChen Shu, Hongjun Xu, Ruichi Zhang, Mengke Li et al.NeurIPS 2025
