Class-Dependent Label-Noise Learning with Cycle-Consistency Regularization
De Cheng, Yixiong Ning, Nannan Wang, Xinbo Gao, Heng Yang, Yuxuan Du, Bo Han, Tongliang Liu
Abstract
. Abstract In label-noise learning, estimating the transition matrix plays an important role in building statistically consistent classifier. Current state-of-the-art consistent estimator for the transition matrix has been developed under the newly proposed sufficiently scattered assumption, through incorporating the minimum volume constraint of the transition matrix T into label-noise learning. To compute the volume of T , it heavily relies on the estimated noisy class posterior . However, the estimation error of the noisy class posterior could usually be large as deep learning methods tend to easily overfit the noisy labels. Then, directly minimizing the volume of such obtained T could lead the transition matrix to be poorly estimated. How to reduce the side-effects of the inaccurate noisy class posterior remains unsolved. In this paper, we creatively propose to estimate the transition matrix under a forward-backward cycle-consistency regularization, of which we have greatly reduced the dependency of estimating the transition matrix T on the noisy class posterior . Extensive experimental results consistently justify the effectiveness of the proposed method, on reducing the estimation error of the transition matrix and greatly boosting the classification performance.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext bb631c8a-9977-48a9-89b8-dc541de967f2Cited by top-tier papers18
- Estimating Noise Transition Matrix with Label Correlations for Noisy Multi-Label LearningShikun Li, Xiaobo Xia, Hansong Zhang, Yibing Zhan et al.NeurIPS 2022 · 95 citations
- When Noisy Labels Meet Long Tail Dilemmas: A Representation Calibration MethodManyi Zhang, Xuyang Zhao, Jun Yao, Chun Yuan et al.ICCV 2023 · 37 citations
- Scale-teaching: Robust Multi-scale Training for Time Series Classification with Noisy LabelsZhen Liu, Peitian Ma, Dongliang Chen, Wenbin Pei et al.NeurIPS 2023 · 29 citations
- Learning the Latent Causal Structure for Modeling Label NoiseYexiong Lin, Yu Yao, Tongliang LiuNeurIPS 2024 · 22 citations
- Label-Noise Robust Diffusion ModelsByeonghu Na, Yeongmin Kim, HeeSun Bae, Jung Hyun Lee et al.ICLR 2024 · 20 citations
Builds on18
- DivideMix: Learning with Noisy Labels as Semi-supervised LearningJunnan Li, Richard Socher, Steven C. H. HoiICLR 2020 · 1,326 citations
- Symmetric Cross Entropy for Robust Learning With Noisy LabelsYisen Wang, Xingjun Ma, Zaiyi Chen, Yuan Luo et al.ICCV 2019 · 1,125 citations
- Early-Learning Regularization Prevents Memorization of Noisy LabelsSheng Liu, Jonathan Niles-Weed, Narges Razavian, Carlos Fernandez-GrandaNeurIPS 2020 · 798 citations
- Part-dependent Label Noise: Towards Instance-dependent Label NoiseXiaobo Xia, Tongliang Liu, Bo Han, Nannan Wang et al.NeurIPS 2020 · 329 citations
- Robust early-learning: Hindering the memorization of noisy labelsXiaobo Xia, Tongliang Liu, Bo Han, Chen Gong et al.ICLR 2021 · 322 citations
Related papers
- Provably End-to-end Label-noise Learning without Anchor PointsXuefeng Li, Tongliang Liu, Bo Han, Gang Niu et al.ICML 2021 · 161 citations
- Dual T: Reducing Estimation Error for Transition Matrix in Label-noise LearningYu Yao, Tongliang Liu, Bo Han, Mingming Gong et al.NeurIPS 2020 · 297 citations
- Estimating Instance-dependent Bayes-label Transition Matrix using a Deep Neural NetworkShuo Yang, Erkun Yang, Bo Han, Yang Liu et al.ICML 2022 · 59 citations
- Learning Noise Transition Matrix from Only Noisy Labels via Total Variation RegularizationYivan Zhang, Gang Niu, Masashi SugiyamaICML 2021 · 107 citations
- Instance-Dependent Label-Noise Learning with Manifold-Regularized Transition Matrix EstimationDe Cheng, Tongliang Liu, Yixiong Ning, Nannan Wang et al.CVPR 2022 · 63 citations
