Evidential Deep Partial Label Learning to Quantify Disambiguation Uncertainty
Jinfu Fan, Jiangnan Li, Xiaohui Zhong, Kangrui Ren, Zhencun Jiang, Min Gan, Tianhao Gu, Linqing Huang
Abstract
Partial label learning (PLL) is a weakly supervised learning, where each instance is assigned a set of candidate labels and only one is true. However, due to potentially inaccurate annotations, existing PLL algorithms disambiguate labeling by minimizing the prediction loss, which leaves the model unaware of its prediction credibility. To address this issue, this paper proposes the evidential deep partial label learning (ED-PLL) to quantify disambiguation uncertainty, aiming to achieve candidate label disambiguation and reliability prediction. Firstly, we extend the evidence modeling mechanism to PLL, treating the candidate label set as the source of evidence for the label hypothesis, and using belief and credibility to model classification uncertainty, thereby guiding a more reliable disambiguation process. Meanwhile, we propose the expectation calculation under the Dirichlet distribution of non-candidate labels, which suppresses the output of non-candidate labels by using consistency regularization to further improve the accuracy of disambiguation. Furthermore, a conflict-aware regularization is proposed to evaluate the degree of conflict, which measures the consistency between instances within the class by combining the differences in the distribution of prediction results and model uncertainty, and thus improves the robustness of the model. In addition, this paper theoretically analyzes our method from the perspective of the Expectation-Maximization (EM) algorithm, and the ED-PLL is compatible with any deep network or stochastic optimizer. Experiments on benchmark and real datasets verify the effectiveness of the proposed algorithm.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 40bb3390-7199-46e9-8863-8be63f500548Builds on9
- Deep Evidential RegressionAlexander Amini, Wilko Schwarting, Ava Soleimany, Daniela RusNeurIPS 2020 · 777 citations
- Progressive Identification of True Labels for Partial-Label LearningJiaqi Lv, Miao Xu, Lei Feng, Gang Niu et al.ICML 2020 · 220 citations
- Provably Consistent Partial-Label LearningLei Feng, Jiaqi Lv, Bo Han, Miao Xu et al.NeurIPS 2020 · 188 citations
- Leveraged Weighted Loss for Partial Label LearningHongwei Wen, Jingyi Cui, Hanyuan Hang, Jiabin Liu et al.ICML 2021 · 119 citations
- Instance-Dependent Partial Label LearningNing Xu, Congyu Qiao, Xin Geng, Min-Ling ZhangNeurIPS 2021 · 110 citations
Related papers
- Revisiting Consistency Regularization for Deep Partial Label LearningDong-Dong Wu, Deng-Bao Wang, Min-Ling ZhangICML 2022 · 85 citations
- Decompositional Generation Process for Instance-Dependent Partial Label LearningCongyu Qiao, Ning Xu, Xin GengICLR 2023 · 1 citation
- Controller-Guided Partial Label Consistency Regularization with Unlabeled DataQian-Wei Wang, Bowen Zhao, Mingyan Zhu, Tianxiang Li et al.AAAI 2024 · 3 citations
- Semantic Dissimilarity Guided Locality Preserving Projections for Partial Label Dimensionality ReductionYuheng Jia, Jiahao Jiang, Yongheng WangKDD 2023 · 2 citations
- Variational Label EnhancementNing Xu, Jun Shu, Yun-Peng Liu, Xin GengICML 2020 · 13 citations
