Active Domain Adaptation via Clustering Uncertainty-weighted Embeddings
Viraj Prabhu, Arjun Chandrasekaran, Kate Saenko, Judy Hoffman
Abstract
Generalizing deep neural networks to new target domains is critical to their real-world utility. In practice, it may be feasible to get some target data labeled, but to be cost-effective it is desirable to select a maximally-informative subset via active learning (AL). We study the problem of AL under a domain shift, called Active Domain Adaptation (Active DA). We demonstrate how existing AL approaches based solely on model uncertainty or diversity sampling are less effective for Active DA. We propose Clustering Uncertainty-weighted Embeddings (CLUE), a novel label acquisition strategy for Active DA that performs uncertainty-weighted clustering to identify target instances for labeling that are both uncertain under the model and diverse in feature space. CLUE consistently outperforms competing label acquisition strategies for Active DA and AL across learning settings on 6 diverse domain shifts for image classification. Our code is available at https://github.com/virajprabhu/CLUE .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext b3d9598f-8a72-4906-9958-10ea9993df2fCited by top-tier papers37
- Active Learning for Domain Adaptation: An Energy-Based ApproachBinhui Xie, Longhui Yuan, Shuang Li, Chi Harold Liu et al.AAAI 2022 · 149 citations
- Deep Co-Training with Task Decomposition for Semi-Supervised Domain AdaptationLuyu Yang, Yan Wang, Mingfei Gao, Abhinav Shrivastava et al.ICCV 2021 · 91 citations
- Towards Fewer Annotations: Active Learning via Region Impurity and Prediction Uncertainty for Domain Adaptive Semantic SegmentationBinhui Xie, Longhui Yuan, Shuang Li, Chi Harold Liu et al.CVPR 2022 · 89 citations
- LabOR: Labeling Only if Required for Domain Adaptive Semantic SegmentationInkyu Shin, Dong-Jin Kim, Jae-Won Cho, Sanghyun Woo et al.ICCV 2021 · 68 citations
- Meta Agent Teaming Active Learning for Pose EstimationJia Gong, Zhipeng Fan, Qiuhong Ke, Hossein Rahmani et al.CVPR 2022 · 53 citations
Builds on4
- Moment Matching for Multi-Source Domain AdaptationXingchao Peng, Qinxun Bai, Xide Xia, Zijun Huang et al.ICCV 2019 · 2,239 citations
- Deep Batch Active Learning by Diverse, Uncertain Gradient Lower BoundsJordan T. Ash, Chicheng Zhang, Akshay Krishnamurthy, John Langford et al.ICLR 2020 · 974 citations
- Semi-Supervised Domain Adaptation via Minimax EntropyKuniaki Saito, Donghyun Kim, Stan Sclaroff, Trevor Darrell et al.ICCV 2019 · 725 citations
- Variational Adversarial Active LearningSamarth Sinha, Sayna Ebrahimi, Trevor DarrellICCV 2019 · 662 citations
Related papers
- Dirichlet-based Uncertainty Calibration for Active Domain AdaptationMixue Xie, Shuang Li, Rui Zhang, Chi Harold LiuICLR 2023 · 12 citations
- Active Universal Domain AdaptationXinhong Ma, Junyu Gao, Changsheng XuICCV 2021 · 36 citations
- Divide and Adapt: Active Domain Adaptation via Customized LearningDuojun Huang, Jichang Li, Weikai Chen, Junshi Huang et al.CVPR 2023
- Transferable Query Selection for Active Domain AdaptationBo Fu, Zhangjie Cao, Jianmin Wang, Mingsheng LongCVPR 2021
- GALAXY: Graph-based Active Learning at the ExtremeJifan Zhang, Julian Katz-Samuels, Robert D. NowakICML 2022 · 47 citations
