Learning Imbalanced Data with Beneficial Label Noise
Guangzheng Hu, Feng Liu, Mingming Gong, Guanghui Wang, Liuhua Peng
Abstract
Data imbalance is a common factor hindering classifier performance. Data-level approaches for imbalanced learning, such as resampling, often lead to information loss or generative errors. Building on theoretical studies of imbalance ratio in binary classification, it is found that adding suitable label noise can adjust biased decision boundaries and improve classifier performance. This paper proposes the Label-Noise-based Rebalancing (LNR) approach to solve imbalanced learning by employing a novel design of an asymmetric label noise model. In contrast to other data-level methods, LNR alleviates the issues of informative loss and generative errors and can be integrated seamlessly with any classifier or algorithm-level method. We validated the superiority of LNR on synthetic and real-world datasets. Our work opens a new avenue for imbalanced learning, highlighting the potential of beneficial label noise. Code is available at https: //github.com/guangzhengh/LNR.git
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext eac0bba8-c96c-40bb-9c67-f2a0e96fd282Builds on11
- Decoupling Representation and Classifier for Long-Tailed RecognitionBingyi Kang, Saining Xie, Marcus Rohrbach, Zhicheng Yan et al.ICLR 2020 · 1,496 citations
- Long-tailed Recognition by Routing Diverse Distribution-Aware ExpertsXudong Wang, Long Lian, Zhongqi Miao, Ziwei Liu et al.ICLR 2021 · 481 citations
- To be Robust or to be Fair: Towards Fairness in Adversarial TrainingHan Xu, Xiaorui Liu, Yaxin Li, Anil K. Jain et al.ICML 2021 · 218 citations
- Targeted Supervised Contrastive Learning for Long-Tailed RecognitionTianhong Li, Peng Cao, Yuan Yuan, Lijie Fan et al.CVPR 2022 · 196 citations
- Nested Collaborative Learning for Long-Tailed Visual RecognitionJun Li, Zichang Tan, Jun Wan, Zhen Lei et al.CVPR 2022 · 95 citations
Related papers
- Influence-Balanced Loss for Imbalanced Visual ClassificationSeulki Park, Jongin Lim, Younghan Jeon, Jin Young ChoiICCV 2021 · 183 citations
- Self-paced Ensemble for Highly Imbalanced Massive Data ClassificationZhining Liu, Wei Cao, Zhifeng Gao, Jiang Bian et al.ICDE 2020 · 172 citations
- Can Less be More? When Increasing-to-Balancing Label Noise Rates Considered BeneficialYang Liu, Jialu WangNeurIPS 2021 · 24 citations
- Asymmetric Loss Functions for Learning with Noisy LabelsXiong Zhou, Xianming Liu, Junjun Jiang, Xin Gao et al.ICML 2021 · 92 citations
- Generalized DataWeighting via Class-Level Gradient ManipulationCan Chen, Shuhao Zheng, Xi Chen, Erqun Dong et al.NeurIPS 2021 · 28 citations
