Domain Adaptation with Adaptive -Divergence: Tighter Variational Representation and Generalization Bounds
Zhe Cheng, Fode Zhang, Yifan Zhu, Lingrui Wang, Jiaolong Wang
Abstract
We study unsupervised domain adaptation (UDA) where measuring cross-domain discrepancy is critical. Most UDA approaches fix a single -divergence a priori, which can be suboptimal across heterogeneous shifts. We propose a framework that (i) tightens the variational lower bound of an -divergence by inserting a learnable, monotone -Lipschitz transform (Tighter-VR), and (ii) selects the divergence family adaptively from data via a likelihood-based criterion. The resulting estimator yields more informative and statistically efficient discrepancy estimates while recovering prior fixed-divergence methods as special cases. Theoretically, we derive a target-risk bound whose three components are a transformed source risk, a Tighter-VR discrepancy between domains, and an ideal-hypothesis residual; we further provide finite-sample guarantees using standard complexity measures. Empirically, on Office-31, Office-Home, Digits, and VisDA-2017, our method consistently improves accuracy over strong baselines, showing that coupling Tighter-VR with adaptive divergence selection is useful for UDA.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext cfaab671-0a01-488a-8a52-e3b131eb55d7Builds on18
- Training data-efficient image transformers & distillation through attentionHugo Touvron, Matthieu Cord, Matthijs Douze, Francisco Massa et al.ICML 2021 · 8,974 citations
- CDTrans: Cross-domain Transformer for Unsupervised Domain AdaptationTongkun Xu, Weihua Chen, Pichao Wang, Fan Wang et al.ICLR 2022 · 293 citations
- Domain Adaptation with Conditional Distribution Matching and Generalized Label ShiftRemi Tachet des Combes, Han Zhao, Yu-Xiang Wang, Geoffrey J. GordonNeurIPS 2020 · 231 citations
- Prompt-Based Distribution Alignment for Unsupervised Domain AdaptationShuanghao Bai, Min Zhang, Wanqi Zhou, Siteng Huang et al.AAAI 2024 · 103 citations
- Adversarial Training Based Multi-Source Unsupervised Domain Adaptation for Sentiment AnalysisYong Dai, Jian Liu, Xiancong Ren, Zenglin XuAAAI 2020 · 66 citations
Related papers
- On -Divergence Principled Domain Adaptation: An Improved FrameworkZiqiao Wang, Yongyi MaoNeurIPS 2024 · 13 citations
- f-Domain Adversarial Learning: Theory and AlgorithmsDavid Acuna, Guojun Zhang, Marc T. Law, Sanja FidlerICML 2021 · 77 citations
- Distributionally Robust Classification for Multi-source Unsupervised Domain AdaptationSeonghwi Kim, Sungho Jo, Wooseok Ha, Minwoo ChaeICLR 2026 · 4 citations
- Information-Theoretic Analysis of Unsupervised Domain AdaptationZiqiao Wang, Yongyi MaoICLR 2023 · 4 citations
- CASUAL: Conditional Support Alignment for Domain Adaptation with Label ShiftAnh T. Nguyen, Lam Tran, Anh Tong, Tuan-Duy H. Nguyen et al.AAAI 2025 · 3 citations
