Label-Aware Global Consistency for Multi-Label Learning with Single Positive Labels
Ming-Kun Xie, Jiahao Xiao, Sheng-Jun Huang
Abstract
In single positive multi-label learning (SPML), only one of multiple positive labels is observed for each instance. The previous work trains the model by simply treating unobserved labels as negative ones, and designs the regularization to constrain the number of expected positive labels. However, in many real-world scenarios, the true number of positive labels is unavailable, making such methods less applicable. In this paper, we propose to solve SPML problems by designing a Label-Aware global Consistency (LAC) regularization, which leverages the manifold structure information to enhance the recovery of potential positive labels. On one hand, we first perform pseudo-labeling for each unobserved label based on its prediction probability. The consistency regularization is then imposed on model outputs to balance the fitting of identified labels and exploring of potential positive labels. On the other hand, by enforcing label-wise embeddings to maintain global consistency, LAC loss encourages the model to learn more distinctive representations, which is beneficial for recovering the information of potential positive labels. Experiments on multiple benchmark datasets validate that the proposed method can achieve state-of-the-art performance for solving SPML tasks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a53a2cdf-742b-453a-b63e-b5f73e54ea77Cited by top-tier papers12
- Class-Distribution-Aware Pseudo-Labeling for Semi-Supervised Multi-Label LearningMing-Kun Xie, Jiahao Xiao, Hao-Zhe Liu, Gang Niu et al.NeurIPS 2023 · 55 citations
- Revisiting Pseudo-Label for Single-Positive Multi-Label LearningBiao Liu, Ning Xu, Jiaqi Lv, Xin GengICML 2023 · 26 citations
- Partial Multi-Label Learning with Probabilistic Graphical DisambiguationJun-Yi Hang, Min-Ling ZhangNeurIPS 2023 · 22 citations
- Holistic Label Correction for Noisy Multi-Label ClassificationXiaobo Xia, Jiankang Deng, Wei Bao, Yuxuan Du et al.ICCV 2023 · 13 citations
- Counterfactual Reasoning for Multi-Label Image Classification via Patching-Based TrainingMing-Kun Xie, Jiahao Xiao, Pei Peng, Gang Niu et al.ICML 2024 · 11 citations
Builds on9
- RandAugment: Practical Automated Data Augmentation with a Reduced Search SpaceEkin Dogus Cubuk, Barret Zoph, Jonathon Shlens, Quoc LeNeurIPS 2020 · 4,453 citations
- Multi-Label Classification with Label Graph SuperimposingYa Wang, Dongliang He, Fu Li, Xiang Long et al.AAAI 2020 · 192 citations
- PiCO: Contrastive Label Disambiguation for Partial Label LearningHaobo Wang, Ruixuan Xiao, Yixuan Li, Lei Feng et al.ICLR 2022 · 169 citations
- Semantic-Aware Representation Blending for Multi-Label Image Recognition with Partial LabelsTao Pu, Tianshui Chen, Hefeng Wu, Liang LinAAAI 2022 · 58 citations
- Dual Relation Semi-Supervised Multi-Label LearningLichen Wang, Yunyu Liu, Can Qin, Gan Sun et al.AAAI 2020 · 47 citations
Related papers
- Revisiting Consistency Regularization for Deep Partial Label LearningDong-Dong Wu, Deng-Bao Wang, Min-Ling ZhangICML 2022 · 85 citations
- Saliency Regularization for Self-Training with Partial AnnotationsShouwen Wang, Qian Wan, Xiang Xiang, Zhigang ZengICCV 2023 · 7 citations
- Controller-Guided Partial Label Consistency Regularization with Unlabeled DataQian-Wei Wang, Bowen Zhao, Mingyan Zhu, Tianxiang Li et al.AAAI 2024 · 3 citations
- Partial Multi-Label Learning with Label DistributionNing Xu, Yun-Peng Liu, Xin GengAAAI 2020 · 85 citations
- One Coin Has Two Sides: Single Poistive Multi Label Learning from Salient AnnotationsXiaoyu Wang, Zhuoming Li, Bo Han, Hui LIU et al.ICML 2026
