Directional Label Diffusion Model for Learning from Noisy Labels
Senyu Hou, Gaoxia Jiang, Jia Zhang, Shangrong Yang, Husheng Guo, Yaqing Guo, Wenjian Wang
Abstract
In image classification, the label quality of training data critically influences model generalization, especially for deep neural networks (DNNs). Traditionally, learning from noisy labels (LNL) can improve the generalization of DNNs through complex architectures or a series of robust techniques, but its performance improvement is limited by the discriminative paradigm. Unlike traditional ways, we resolve the LNL problems from the perspective of robust label generation, based on diffusion models within the generative paradigm. To expand the diffusion model into a robust classifier that explicitly accommodates more noise knowledge, we propose a Directional Label Diffusion (DLD) model. It disentangles the diffusion process into two paths, i.e., directional diffusion and random diffusion. Specifically, directional diffusion simulates the corruption of true labels into a directed noise distribution, prioritizing the removal of likely noise, whereas random diffusion introduces inherent randomness to support label recovery. This architecture enable DLD to gradually infer labels from an initial random state, interpretably diverging from the specified noise distribution. To adapt the model to diverse noisy environments, we design a low-cost label precorrection method that automatically supplies more accurate label information to the diffusion model, without requiring manual intervention or additional iterations. Our approach outperforms state-of-the-art methods on both simulated and real-world noisy datasets. Code is available at https://github.com/SenyuHou/DLD .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext b7ec4823-b198-4877-a9c8-0556dd4c9db5Cited by top-tier papers3
- Noise-Aware Generalization: Robustness to In-Domain Noise and Out-of-Domain GeneralizationSiqi Wang, Aoming Liu, Bryan A. PlummerICLR 2026 · 3 citations
- Just Y-Prediction: Enabling Historical Cumulative Inconsistency in Label Diffusion for Learning with Noisy LabelSenyu Hou, Gaoxia Jiang, Xinyi Zheng, Yaqing Guo et al.ICML 2026
- Adaptive Momentum and EMA-weighted Modeling for Imbalanced Label Distribution LearningYongbiao Gao, Xiangcheng Sun, Chao Tan, Chunyu Hu et al.AAAI 2026
Builds on29
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 11,743 citations
- FixMatch: Simplifying Semi-Supervised Learning with Consistency and ConfidenceKihyuk Sohn, David Berthelot, Nicholas Carlini, Zizhao Zhang et al.NeurIPS 2020 · 5,129 citations
Related papers
- Label-Retrieval-Augmented Diffusion Models for Learning from Noisy LabelsJian Chen, Ruiyi Zhang, Tong Yu, Rohan Sharma et al.NeurIPS 2023 · 44 citations
- Stochastic Conditional Diffusion Models for Robust Semantic Image SynthesisJuyeon Ko, Inho Kong, Dogyun Park, Hyunwoo J. KimICML 2024 · 14 citations
- DISC: Learning from Noisy Labels via Dynamic Instance-Specific Selection and CorrectionYifan Li, Hu Han, Shiguang Shan, Xilin ChenCVPR 2023
- Tackling Instance-Dependent Label Noise via a Universal Probabilistic ModelQizhou Wang, Bo Han, Tongliang Liu, Gang Niu et al.AAAI 2021 · 34 citations
- Label-Noise Robust Diffusion ModelsByeonghu Na, Yeongmin Kim, HeeSun Bae, Jung Hyun Lee et al.ICLR 2024 · 20 citations
