Semi-Supervised Domain Adaptation via Minimax Entropy
Kuniaki Saito, Donghyun Kim, Stan Sclaroff, Trevor Darrell, Kate Saenko
Abstract
Contemporary domain adaptation methods are very effective at aligning feature distributions of source and target domains without any target supervision. However, we show that these techniques perform poorly when even a few labeled examples are available in the target domain. To address this semi-supervised domain adaptation (SSDA) setting, we propose a novel Minimax Entropy (MME) approach that adversarially optimizes an adaptive few-shot model. Our base model consists of a feature encoding network, followed by a classification layer that computes the features' similarity to estimated prototypes (representatives of each class). Adaptation is achieved by alternately maximizing the conditional entropy of unlabeled target data with respect to the classifier and minimizing it with respect to the feature encoder. We empirically demonstrate the superiority of our method over many baselines, including conventional feature alignment and few-shot methods, setting a new state of the art for SSDA. Our code is available at http://cs-people.bu.edu/keisaito/research/MME.html.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 0d5015be-6474-4b4f-9ae5-ebb0eeb3a5d1Cited by top-tier papers131
- Tent: Fully Test-Time Adaptation by Entropy MinimizationDequan Wang, Evan Shelhamer, Shaoteng Liu, Bruno A. Olshausen et al.ICLR 2021 · 1,731 citations
- Do We Really Need to Access the Source Data? Source Hypothesis Transfer for Unsupervised Domain AdaptationJian Liang, Dapeng Hu, Jiashi FengICML 2020 · 1,624 citations
- Universal Domain Adaptation through Self SupervisionKuniaki Saito, Donghyun Kim, Stan Sclaroff, Kate SaenkoNeurIPS 2020 · 401 citations
- Learning to Diversify for Single Domain GeneralizationZijian Wang, Yadan Luo, Ruihong Qiu, Zi Huang et al.ICCV 2021 · 339 citations
- Contrastive Test-Time AdaptationDian Chen, Dequan Wang, Trevor Darrell, Sayna EbrahimiCVPR 2022 · 219 citations
Builds on1
Related papers
- High-Level Semantic Feature Matters Few-Shot Unsupervised Domain AdaptationLei Yu, Wanqi Yang, Shengqi Huang, Lei Wang et al.AAAI 2023 · 7 citations
- Few-shot Unsupervised Domain Adaptation with Image-to-Class Sparse Similarity EncodingShengqi Huang, Wanqi Yang, Lei Wang, Luping Zhou et al.ACM MM 2021 · 9 citations
- Prototypical Cross-Domain Self-Supervised Learning for Few-Shot Unsupervised Domain AdaptationXiangyu Yue, Zangwei Zheng, Shanghang Zhang, Yang Gao et al.CVPR 2021
- Self-training Avoids Using Spurious Features Under Domain ShiftYining Chen, Colin Wei, Ananya Kumar, Tengyu MaNeurIPS 2020 · 100 citations
- Discriminative Adversarial Domain AdaptationHui Tang, Kui JiaAAAI 2020 · 229 citations
