A Prototype-Oriented Framework for Unsupervised Domain Adaptation
Korawat Tanwisuth, Xinjie Fan, Huangjie Zheng, Shujian Zhang, Hao Zhang, Bo Chen, Mingyuan Zhou
Abstract
Existing methods for unsupervised domain adaptation often rely on minimizing some statistical distance between the source and target samples in the latent space. To avoid the sampling variability, class imbalance, and data-privacy concerns that often plague these methods, we instead provide a memory and computation-efficient probabilistic framework to extract class prototypes and align the target features with them. We demonstrate the general applicability of our method on a wide range of scenarios, including single-source, multi-source, class-imbalance, and source-private domain adaptation. Requiring no additional model parameters and having a moderate increase in computation over the source model alone, the proposed method achieves competitive performance with state-of-the-art methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext bb483de4-d0c0-46ae-9081-e769f0e138d1Cited by top-tier papers30
- DINE: Domain Adaptation from Single and Multiple Black-box PredictorsJian Liang, Dapeng Hu, Jiashi Feng, Ran HeCVPR 2022 · 80 citations
- Representing Mixtures of Word Embeddings with Mixtures of Topic EmbeddingsDongsheng Wang, Dandan Guo, He Zhao, Huangjie Zheng et al.ICLR 2022 · 56 citations
- POUF: Prompt-Oriented Unsupervised Fine-tuning for Large Pre-trained ModelsKorawat Tanwisuth, Shujian Zhang, Huangjie Zheng, Pengcheng He et al.ICML 2023 · 44 citations
- Taming Cross-Domain Representation Variance in Federated Prototype Learning with Heterogeneous Data DomainsLei Wang, Jieming Bian, Letian Zhang, Chen Chen et al.NeurIPS 2024 · 36 citations
- Prototype-oriented unsupervised anomaly detection for multivariate time seriesYuxin Li, Wenchao Chen, Bo Chen, Dongsheng Wang et al.ICML 2023 · 31 citations
Builds on15
- Moment Matching for Multi-Source Domain AdaptationXingchao Peng, Qinxun Bai, Xide Xia, Zijun Huang et al.ICCV 2019 · 2,239 citations
- Do We Really Need to Access the Source Data? Source Hypothesis Transfer for Unsupervised Domain AdaptationJian Liang, Dapeng Hu, Jiashi FengICML 2020 · 1,624 citations
- Semi-Supervised Domain Adaptation via Minimax EntropyKuniaki Saito, Donghyun Kim, Stan Sclaroff, Trevor Darrell et al.ICCV 2019 · 725 citations
- Universal Domain Adaptation through Self SupervisionKuniaki Saito, Donghyun Kim, Stan Sclaroff, Kate SaenkoNeurIPS 2020 · 401 citations
- Domain Adaptation with Conditional Distribution Matching and Generalized Label ShiftRemi Tachet des Combes, Han Zhao, Yu-Xiang Wang, Geoffrey J. GordonNeurIPS 2020 · 231 citations
Related papers
- Implicit Class-Conditioned Domain Alignment for Unsupervised Domain AdaptationXiang Jiang, Qicheng Lao, Stan Matwin, Mohammad HavaeiICML 2020 · 129 citations
- Model Adaptation: Unsupervised Domain Adaptation Without Source DataRui Li, Qianfen Jiao, Wenming Cao, Hau-San Wong et al.CVPR 2020
- Unsupervised Domain Adaptation via Regularized Conditional AlignmentSafa Cicek, Stefano SoattoICCV 2019 · 127 citations
- On Balancing Bias and Variance in Unsupervised Multi-Source-Free Domain AdaptationMaohao Shen, Yuheng Bu, Gregory W. WornellICML 2023 · 22 citations
- Domain Adaptation with Invariant Representation Learning: What Transformations to Learn?Petar Stojanov, Zijian Li, Mingming Gong, Ruichu Cai et al.NeurIPS 2021 · 70 citations
