Noisy Multi-Label Learning through Co-Occurrence-Aware Diffusion
Senyu Hou, Yuru Ren, Gaoxia Jiang, Wenjian Wang
Abstract
Noisy labels often compel models to overfit, especially in multi-label classification tasks. Existing methods for noisy multi-label learning (NML) primarily follow a discriminative paradigm, which relies on noise transition matrix estimation or small-loss strategies to correct noisy labels. However, they remain substantial optimization difficulties compared to noisy single-label learning. In this paper, we propose a C o-Occurrence-A ware D iffusion (CAD) model, which reformulates NML from a generative perspective. We treat features as conditions and multi-labels as diffusion targets, optimizing the diffusion model for multi-label learning with theoretical guarantees. Benefiting from the diffusion model’s strength in capturing multi-object semantics and structured label matrix representation, we can effectively learn the posterior mapping from features to true multi-labels. To mitigate the interference of noisy labels in the forward process, we guide generation using pseudo-clean labels reconstructed from the latent neighborhood space, replacing original point-wise estimates with neighborhood-based proxies. In the reverse process, we further incorporate label co-occurrence constraints to enhance the model’s awareness of incorrect generation directions, thereby promoting robust optimization. Extensive experiments on both synthetic (Pascal-VOC, MS-COCO) and real-world (NUS-WIDE) noisy datasets demonstrate that our approach outperforms state-of-the-art methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on28
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 13,211 citations
- Directly Denoising Diffusion ModelsDan Zhang, Jingjing Wang, Feng LuoICML 2024 · 11,724 citations
- DivideMix: Learning with Noisy Labels as Semi-supervised LearningJunnan Li, Richard Socher, Steven C. H. HoiICLR 2020 · 1,326 citations
Related papers
- Label-Retrieval-Augmented Diffusion Models for Learning from Noisy LabelsJian Chen, Ruiyi Zhang, Tong Yu, Rohan Sharma et al.NeurIPS 2023 · 44 citations
- Label-Noise Robust Diffusion ModelsByeonghu Na, Yeongmin Kim, HeeSun Bae, Jung Hyun Lee et al.ICLR 2024 · 20 citations
- From Noisy Prediction to True Label: Noisy Prediction Calibration via Generative ModelHeeSun Bae, Seungjae Shin, Byeonghu Na, JoonHo Jang et al.ICML 2022 · 29 citations
- Multi-Task Dense Predictions via Unleashing the Power of DiffusionYuqi Yang, Peng-Tao Jiang, Qibin Hou, Hao Zhang et al.ICLR 2025
- Estimating Noisy Class Posterior with Part-level Labels for Noisy Label LearningRui Zhao, Bin Shi, Jianfei Ruan, Tianze Pan et al.CVPR 2024
