On Unsupervised Domain Adaptation: Pseudo Label Guided Mixup for Adversarial Prompt Tuning
Fanshuang Kong, Richong Zhang, Ziqiao Wang, Yongyi Mao
Abstract
To date, a backbone of methods for unsupervised domain adaptation (UDA) involves learning label-discriminative features via a label classifier and domain-invariant features through a domain discriminator in an adversarial scheme. However, these methods lack explicit control for aligning the source data and target data within the same label class, degrading the classifier's performance in the target domain. In this paper, we propose PL-Mix, a pseudo label guided Mixup method based on adversarial prompt tuning. Specifically, our PL-Mix facilitates class-dependent alignment and can alleviate the impact of noisy pseudo-labels. We then theoretically justify that PL-Mix can improve the generalization for UDA. Extensive experiments of the comparison with existing models also demonstrate the effectiveness of PL-Mix.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext bed44c97-f2ce-455e-a3e4-24367f9b79e8Cited by top-tier papers1
Ask how each one uses itBuilds on5
- Adversarial Domain Adaptation with Domain MixupMinghao Xu, Jian Zhang, Bingbing Ni, Teng Li et al.AAAI 2020 · 499 citations
- Adversarial and Domain-Aware BERT for Cross-Domain Sentiment AnalysisChunning Du, Haifeng Sun, Jingyu Wang, Qi Qi et al.ACL 2020 · 165 citations
- Adversarial Soft Prompt Tuning for Cross-Domain Sentiment AnalysisHui Wu, Xiaodong ShiACL 2022 · 98 citations
- The Power of Scale for Parameter-Efficient Prompt TuningBrian Lester, Rami Al-Rfou, Noah ConstantEMNLP 2021 · 94 citations
- Provable Benefit of Mixup for Finding Optimal Decision BoundariesJunsoo Oh, Chulhee YunICML 2023 · 6 citations
Related papers
- Implicit Class-Conditioned Domain Alignment for Unsupervised Domain AdaptationXiang Jiang, Qicheng Lao, Stan Matwin, Mohammad HavaeiICML 2020 · 129 citations
- Prompt-Based Distribution Alignment for Unsupervised Domain AdaptationShuanghao Bai, Min Zhang, Wanqi Zhou, Siteng Huang et al.AAAI 2024 · 103 citations
- ToAlign: Task-Oriented Alignment for Unsupervised Domain AdaptationGuoqiang Wei, Cuiling Lan, Wenjun Zeng, Zhizheng Zhang et al.NeurIPS 2021 · 80 citations
- Connect, Not Collapse: Explaining Contrastive Learning for Unsupervised Domain AdaptationKendrick Shen, Robbie M. Jones, Ananya Kumar, Sang Michael Xie et al.ICML 2022 · 102 citations
- Adversarial-Learned Loss for Domain AdaptationMinghao Chen, Shuai Zhao, Haifeng Liu, Deng CaiAAAI 2020 · 195 citations
