Domain Adaptation with Adaptive -Divergence: Tighter Variational Representation and Generalization Bounds
Zhe Cheng, Fode Zhang, Yifan Zhu, Lingrui Wang, Jiaolong Wang
摘要
We study unsupervised domain adaptation (UDA) where measuring cross-domain discrepancy is critical. Most UDA approaches fix a single -divergence a priori, which can be suboptimal across heterogeneous shifts. We propose a framework that (i) tightens the variational lower bound of an -divergence by inserting a learnable, monotone -Lipschitz transform (Tighter-VR), and (ii) selects the divergence family adaptively from data via a likelihood-based criterion. The resulting estimator yields more informative and statistically efficient discrepancy estimates while recovering prior fixed-divergence methods as special cases. Theoretically, we derive a target-risk bound whose three components are a transformed source risk, a Tighter-VR discrepancy between domains, and an ideal-hypothesis residual; we further provide finite-sample guarantees using standard complexity measures. Empirically, on Office-31, Office-Home, Digits, and VisDA-2017, our method consistently improves accuracy over strong baselines, showing that coupling Tighter-VR with adaptive divergence selection is useful for UDA.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper18
- Training data-efficient image transformers & distillation through attentionHugo Touvron, Matthieu Cord, Matthijs Douze, Francisco Massa 等ICML 2021 · 被引用 8,974 次
- CDTrans: Cross-domain Transformer for Unsupervised Domain AdaptationTongkun Xu, Weihua Chen, Pichao Wang, Fan Wang 等ICLR 2022 · 被引用 293 次
- Domain Adaptation with Conditional Distribution Matching and Generalized Label ShiftRemi Tachet des Combes, Han Zhao, Yu-Xiang Wang, Geoffrey J. GordonNeurIPS 2020 · 被引用 231 次
- Prompt-Based Distribution Alignment for Unsupervised Domain AdaptationShuanghao Bai, Min Zhang, Wanqi Zhou, Siteng Huang 等AAAI 2024 · 被引用 103 次
- Adversarial Training Based Multi-Source Unsupervised Domain Adaptation for Sentiment AnalysisYong Dai, Jian Liu, Xiancong Ren, Zenglin XuAAAI 2020 · 被引用 66 次
相关 Paper
- On -Divergence Principled Domain Adaptation: An Improved FrameworkZiqiao Wang, Yongyi MaoNeurIPS 2024 · 被引用 13 次
- f-Domain Adversarial Learning: Theory and AlgorithmsDavid Acuna, Guojun Zhang, Marc T. Law, Sanja FidlerICML 2021 · 被引用 77 次
- Distributionally Robust Classification for Multi-source Unsupervised Domain AdaptationSeonghwi Kim, Sungho Jo, Wooseok Ha, Minwoo ChaeICLR 2026 · 被引用 4 次
- Information-Theoretic Analysis of Unsupervised Domain AdaptationZiqiao Wang, Yongyi MaoICLR 2023 · 被引用 4 次
- CASUAL: Conditional Support Alignment for Domain Adaptation with Label ShiftAnh T. Nguyen, Lam Tran, Anh Tong, Tuan-Duy H. Nguyen 等AAAI 2025 · 被引用 3 次
