Low Category Uncertainty and High Training Potential Instance Learning for Unsupervised Domain Adaptation
Xinyu Zhang, Meng Kang, Shuai Lü
Abstract
Recently, instance contrastive learning achieves good results in unsupervised domain adaptation. It reduces the distances between positive samples and the anchor, increases the distances between negative samples and the anchor, and learns discriminative feature representations for target samples. However, most recent methods for identifying positive and negative samples are based on whether the pseudo-labels of samples and the pseudo-label of the anchor correspond to the same class. Due to the lack of target labels, many uncertain data are mistakenly labeled during the training process, and many low training potential data are also utilized. To address these problems, we propose Low Category Uncertainty and High Training Potential Instance Learning for Unsupervised Domain Adaptation (LUHP). We first propose a weight to measure the category uncertainty of the target sample. We can effectively filter the samples near the decision boundary through category uncertainty thresholds which are calculated by weights. Then we propose a new loss to focus on samples with high training potential. Finally, for anchors with low category uncertainty, we propose a sample reuse strategy to make the model more robust. We demonstrate the effectiveness of LUHP by showing the results of four datasets widely used in unsupervised domain adaptation.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on9
- Moment Matching for Multi-Source Domain AdaptationXingchao Peng, Qinxun Bai, Xide Xia, Zijun Huang et al.ICCV 2019 · 2,239 citations
- FlexMatch: Boosting Semi-Supervised Learning with Curriculum Pseudo LabelingBowen Zhang, Yidong Wang, Wenxin Hou, Hao Wu et al.NeurIPS 2021 · 1,389 citations
- Reusing the Task-specific Classifier as a Discriminator: Discriminator-free Adversarial Domain AdaptationLin Chen, Huaian Chen, Zhixiang Wei, Xin Jin et al.CVPR 2022 · 197 citations
- Category Contrast for Unsupervised Domain Adaptation in Visual TasksJiaxing Huang, Dayan Guan, Aoran Xiao, Shijian Lu et al.CVPR 2022 · 143 citations
- Bi-Classifier Determinacy Maximization for Unsupervised Domain AdaptationShuang Li, Fangrui Lv, Binhui Xie, Chi Harold Liu et al.AAAI 2021 · 131 citations
Related papers
- Model Adaptation: Historical Contrastive Learning for Unsupervised Domain Adaptation without Source DataJiaxing Huang, Dayan Guan, Aoran Xiao, Shijian LuNeurIPS 2021 · 301 citations
- Mutual Nearest Neighbor Contrast and Hybrid Prototype Self-Training for Universal Domain AdaptationLiang Chen, Qianjin Du, Yihang Lou, Jianzhong He et al.AAAI 2022 · 33 citations
- Exploiting Low-confidence Pseudo-labels for Source-free Object DetectionZhihong Chen, Zilei Wang, Yixin ZhangACM MM 2023 · 20 citations
- Connect, Not Collapse: Explaining Contrastive Learning for Unsupervised Domain AdaptationKendrick Shen, Robbie M. Jones, Ananya Kumar, Sang Michael Xie et al.ICML 2022 · 102 citations
- Category Dictionary Guided Unsupervised Domain Adaptation for Object DetectionShuai Li, Jianqiang Huang, Xian-Sheng Hua, Lei ZhangAAAI 2021 · 47 citations
