Weakly-Supervised Contrastive Learning for Imprecise Class Labels
Zi-Hao Zhou, Junjie Wang, Tong Wei, Min-Ling Zhang
Abstract
Contrastive learning has achieved remarkable success in learning effective representations, with supervised contrastive learning often outperforming self-supervised approaches. However, in realworld scenarios, data annotations are often ambiguous or inaccurate, meaning that class labels may not reliably indicate whether two examples belong to the same class. This limitation restricts the applicability of supervised contrastive learning. To address this challenge, we introduce the concept of "continuous semantic similarity" to define positive and negative pairs. Instead of directly relying on imprecise class labels, we measure the semantic similarity between example pairs, which quantifies how closely they belong to the same category by iteratively refining weak supervisory signals. Based on this concept, we propose a graph-theoretic framework for weaklysupervised contrastive learning, where semantic similarity serves as the graph weights. Our framework is highly versatile and can be applied to many weakly-supervised learning scenarios. We demonstrate its effectiveness through experiments in two common settings, i.e., noisy label and partial label learning, where existing methods can be easily integrated to significantly improve performance. Theoretically, we establish an error bound for our approach, showing that it can approximate supervised contrastive learning under mild conditions. The implementation code is available at https://github.com/Speechless-10308/WSC .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7a13e913-d59e-4ffe-a186-5fa5396825f3Cited by top-tier papers2
- Generalization Bounds for Rank-sparse Neural NetworksAntoine Ledent, Rodrigo Alves, Yunwen LeiNeurIPS 2025 · 4 citations
- Noisy-Pair Robust Representation Alignment for Positive-Unlabeled LearningHengwei Zhao, Zhengzhong Tu, Zhuo Zheng, Wei Wang et al.ICLR 2026
Builds on9
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Unsupervised Learning of Visual Features by Contrasting Cluster AssignmentsMathilde Caron, Ishan Misra, Julien Mairal, Priya Goyal et al.NeurIPS 2020 · 5,249 citations
- Safe Deep Semi-Supervised Learning for Unseen-Class Unlabeled DataLan-Zhe Guo, Zhenyu Zhang, Yuan Jiang, Yufeng Li et al.ICML 2020 · 243 citations
- Provably Consistent Partial-Label LearningLei Feng, Jiaqi Lv, Bo Han, Miao Xu et al.NeurIPS 2020 · 188 citations
- Learning with Multiple Complementary LabelsLei Feng, Takuo Kaneko, Bo Han, Gang Niu et al.ICML 2020 · 120 citations
Related papers
- Rethinking Weak Supervision in Helping Contrastive LearningJingyi Cui, Weiran Huang, Yifei Wang, Yisen WangICML 2023 · 20 citations
- Weakly Supervised Contrastive LearningMingkai Zheng, Fei Wang, Shan You, Chen Qian et al.ICCV 2021 · 153 citations
- Selective-Supervised Contrastive Learning with Noisy LabelsShikun Li, Xiaobo Xia, Shiming Ge, Tongliang LiuCVPR 2022 · 201 citations
- Class2Simi: A Noise Reduction Perspective on Learning with Noisy LabelsSonghua Wu, Xiaobo Xia, Tongliang Liu, Bo Han et al.ICML 2021 · 59 citations
- Universal Weakly Supervised Segmentation by Pixel-to-Segment Contrastive LearningTsung-Wei Ke, Jyh-Jing Hwang, Stella X. YuICLR 2021 · 85 citations
