Reusing the Task-specific Classifier as a Discriminator: Discriminator-free Adversarial Domain Adaptation
Lin Chen, Huaian Chen, Zhixiang Wei, Xin Jin, Xiao Tan, Yi Jin, Enhong Chen
Abstract
Adversarial learning has achieved remarkable performances for unsupervised domain adaptation (UDA). Existing adversarial UDA methods typically adopt an additional discriminator to play the min-max game with a feature extractor. However, most of these methods failed to effectively leverage the predicted discriminative information, and thus cause mode collapse for generator. In this work, we address this problem from a different perspective and design a simple yet effective adversarial paradigm in the form of a discriminator-free adversarial learning network (DALN), wherein the category classifier is reused as a discriminator, which achieves explicit domain alignment and category distinguishment through a unified objective, enabling the DALN to leverage the predicted discriminative information for sufficient feature alignment. Basically, we introduce a Nuclear-norm Wasserstein discrepancy (NWD) that has definite guidance meaning for performing discrimination. Such NWD can be coupled with the classifier to serve as a discriminator satisfying the K-Lipschitz constraint without the requirements of additional weight clipping or gradient penalty strategy. Without bells and whistles, DALN compares favorably against the existing state-of-the-art (SOTA) methods on a variety of public datasets. Moreover, as a plug-and-play technique, NWD can be directly used as a generic regularizer to benefit existing UDA algorithms. Code is available at https://github.com/xiaoachen98/DALN .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers38
- PADCLIP: Pseudo-labeling with Adaptive Debiasing in CLIP for Unsupervised Domain AdaptationZhengfeng Lai, Noranart Vesdapunt, Ning Zhou, Jun Wu et al.ICCV 2023 · 90 citations
- SPA: A Graph Spectral Alignment Perspective for Domain AdaptationZhiqing Xiao, Haobo Wang, Ying Jin, Lei Feng et al.NeurIPS 2023 · 60 citations
- Deliberated Domain Bridging for Domain Adaptive Semantic SegmentationLin Chen, Zhixiang Wei, Xin Jin, Huaian Chen et al.NeurIPS 2022 · 51 citations
- Periodically Exchange Teacher-Student for Source-Free Object DetectionQipeng Liu, Luojun Lin, Zhifeng Shen, Zhifeng YangICCV 2023 · 50 citations
- On the Robustness of Open-World Test-Time Training: Self-Training with Dynamic Prototype ExpansionYushu Li, Xun Xu, Yongyi Su, Kui JiaICCV 2023 · 44 citations
Builds on14
- Moment Matching for Multi-Source Domain AdaptationXingchao Peng, Qinxun Bai, Xide Xia, Zijun Huang et al.ICCV 2019 · 2,239 citations
- Discriminative Adversarial Domain AdaptationHui Tang, Kui JiaAAAI 2020 · 229 citations
- Bi-Classifier Determinacy Maximization for Unsupervised Domain AdaptationShuang Li, Fangrui Lv, Binhui Xie, Chi Harold Liu et al.AAAI 2021 · 131 citations
- Semantic Concentration for Domain AdaptationShuang Li, Mixue Xie, Fangrui Lv, Chi Harold Liu et al.ICCV 2021 · 109 citations
- Gradient Distribution Alignment Certificates Better Adversarial Domain AdaptationZhiqiang Gao, Shufei Zhang, Kaizhu Huang, Qiufeng Wang et al.ICCV 2021 · 56 citations
Related papers
- Class Discriminative Adversarial Learning for Unsupervised Domain AdaptationLihua Zhou, Mao Ye, Xiatian Zhu, Shuaifeng Li et al.ACM MM 2022 · 17 citations
- Unsupervised Domain Adaptation via Structurally Regularized Deep ClusteringHui Tang, Ke Chen, Kui JiaCVPR 2020
- Re-energizing Domain Discriminator with Sample Relabeling for Adversarial Domain AdaptationXin Jin, Cuiling Lan, Wenjun Zeng, Zhibo ChenICCV 2021 · 22 citations
- f-Domain Adversarial Learning: Theory and AlgorithmsDavid Acuna, Guojun Zhang, Marc T. Law, Sanja FidlerICML 2021 · 77 citations
- Unsupervised Domain Adaptation via Regularized Conditional AlignmentSafa Cicek, Stefano SoattoICCV 2019 · 127 citations
