Provably End-to-end Label-noise Learning without Anchor Points
Xuefeng Li, Tongliang Liu, Bo Han, Gang Niu, Masashi Sugiyama
Abstract
In label-noise learning, the transition matrix plays a key role in building statistically consistent classifiers. Existing consistent estimators for the transition matrix have been developed by exploiting anchor points. However, the anchor-point assumption is not always satisfied in real scenarios. In this paper, we propose an end-to-end framework for solving label-noise learning without anchor points, in which we simultaneously optimize two objectives: the cross entropy loss between the noisy label and the predicted probability by the neural network, and the volume of the simplex formed by the columns of the transition matrix. Our proposed framework can identify the transition matrix if the clean class-posterior probabilities are sufficiently scattered. This is by far the mildest assumption under which the transition matrix is provably identifiable and the learned classifier is statistically consistent. Experimental results on benchmark datasets demonstrate the effectiveness and robustness of the proposed method.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 76ba07d9-97b8-4836-8136-87a15ce19df8Cited by top-tier papers56
- Learning with Noisy Labels Revisited: A Study Using Real-World Human AnnotationsJiaheng Wei, Zhaowei Zhu, Hao Cheng, Tongliang Liu et al.ICLR 2022 · 338 citations
- Robust early-learning: Hindering the memorization of noisy labelsXiaobo Xia, Tongliang Liu, Bo Han, Chen Gong et al.ICLR 2021 · 322 citations
- Robust Training under Label Noise by Over-parameterizationSheng Liu, Zhihui Zhu, Qing Qu, Chong YouICML 2022 · 152 citations
- Sample Selection with Uncertainty of Losses for Learning with Noisy LabelsXiaobo Xia, Tongliang Liu, Bo Han, Mingming Gong et al.ICLR 2022 · 139 citations
- Clusterability as an Alternative to Anchor Points When Learning with Noisy LabelsZhaowei Zhu, Yiwen Song, Yang LiuICML 2021 · 112 citations
Builds on13
- SELF: Learning to Filter Noisy Labels with Self-EnsemblingDuc Tam Nguyen, Chaithanya Kumar Mummadi, Thi-Phuong-Nhung Ngo, Thi Hoai Phuong Nguyen et al.ICLR 2020 · 354 citations
- Part-dependent Label Noise: Towards Instance-dependent Label NoiseXiaobo Xia, Tongliang Liu, Bo Han, Nannan Wang et al.NeurIPS 2020 · 329 citations
- Robust early-learning: Hindering the memorization of noisy labelsXiaobo Xia, Tongliang Liu, Bo Han, Chen Gong et al.ICLR 2021 · 322 citations
- Dual T: Reducing Estimation Error for Transition Matrix in Label-noise LearningYu Yao, Tongliang Liu, Bo Han, Mingming Gong et al.NeurIPS 2020 · 297 citations
- Peer Loss Functions: Learning from Noisy Labels without Knowing Noise RatesYang Liu, Hongyi GuoICML 2020 · 280 citations
Related papers
- Class-Dependent Label-Noise Learning with Cycle-Consistency RegularizationDe Cheng, Yixiong Ning, Nannan Wang, Xinbo Gao et al.NeurIPS 2022 · 48 citations
- Estimating Noise Transition Matrix with Label Correlations for Noisy Multi-Label LearningShikun Li, Xiaobo Xia, Hansong Zhang, Yibing Zhan et al.NeurIPS 2022 · 95 citations
- Estimating Instance-dependent Bayes-label Transition Matrix using a Deep Neural NetworkShuo Yang, Erkun Yang, Bo Han, Yang Liu et al.ICML 2022 · 59 citations
- A Holistic View of Label Noise Transition Matrix in Deep Learning and BeyondYong Lin, Renjie Pi, Weizhong Zhang, Xiaobo Xia et al.ICLR 2023
- Learning Noise Transition Matrix from Only Noisy Labels via Total Variation RegularizationYivan Zhang, Gang Niu, Masashi SugiyamaICML 2021 · 107 citations
