UCoL: Unsupervised Learning of Discriminative Facial Representations via Uncertainty-Aware Contrast
Hao Wang, Min Li, Yangyang Song, Youjian Zhang, Liying Chi
Abstract
This paper presents Uncertainty-aware Contrastive Learning (UCoL): a fully unsupervised framework for discriminative facial representation learning. Our UCoL is built upon a momentum contrastive network, referred to as Dual-path Momentum Network. Specifically, two flows of pairwise contrastive training are conducted simultaneously: one is formed with intra-instance self augmentation, and the other is to identify positive pairs collected by online pairwise prediction. We introduce a novel uncertainty-aware consistency Knearest neighbors algorithm to generate predicted positive pairs, which enables efficient discriminative learning from large-scale open-world unlabeled data. Experiments show that UCoL significantly improves the baselines of unsupervised models and performs on par with the semi-supervised and supervised face representation learning methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 60032282-588a-4466-ac0a-daddceff37a1Cited by top-tier papers2
- FSFM: A Generalizable Face Security Foundation Model via Self-Supervised Facial Representation LearningGaojian Wang, Feng Lin, Tong Wu, Zhenguang Liu et al.CVPR 2025
- Self-Supervised Facial Representation Learning with Facial Region AwarenessZheng Gao, Ioannis PatrasCVPR 2024
Builds on17
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Unsupervised Learning of Visual Features by Contrasting Cluster AssignmentsMathilde Caron, Ishan Misra, Julien Mairal, Priya Goyal et al.NeurIPS 2020 · 5,249 citations
- An Empirical Study of Training Self-Supervised Vision TransformersXinlei Chen, Saining Xie, Kaiming HeICCV 2021 · 2,340 citations
- SimMIM: a Simple Framework for Masked Image ModelingZhenda Xie, Zheng Zhang, Yue Cao, Yutong Lin et al.CVPR 2022 · 1,129 citations
- Self-labelling via simultaneous clustering and representation learningYuki Markus Asano, Christian Rupprecht, Andrea VedaldiICLR 2020 · 873 citations
Related papers
- CO2: Consistent Contrast for Unsupervised Visual Representation LearningChen Wei, Huiyu Wang, Wei Shen, Alan L. YuilleICLR 2021 · 10 citations
- Dual Contrastive Learning for General Face Forgery DetectionKe Sun, Taiping Yao, Shen Chen, Shouhong Ding et al.AAAI 2022 · 241 citations
- A Theory-Driven Self-Labeling Refinement Method for Contrastive Representation LearningPan Zhou, Caiming Xiong, Xiaotong Yuan, Steven Chu-Hong HoiNeurIPS 2021 · 13 citations
- Promoting Semantic Connectivity: Dual Nearest Neighbors Contrastive Learning for Unsupervised Domain GeneralizationYuchen Liu, Yaoming Wang, Yabo Chen, Wenrui Dai et al.CVPR 2023
- Weakly Supervised Contrastive LearningMingkai Zheng, Fei Wang, Shan You, Chen Qian et al.ICCV 2021 · 153 citations
