ICML2026

Domain Adaptation with Adaptive ff-Divergence: Tighter Variational Representation and Generalization Bounds

Zhe Cheng, Fode Zhang, Yifan Zhu, Lingrui Wang, Jiaolong Wang

Abstract

We study unsupervised domain adaptation (UDA) where measuring cross-domain discrepancy is critical. Most UDA approaches fix a single ff-divergence a priori, which can be suboptimal across heterogeneous shifts. We propose a framework that (i) tightens the variational lower bound of an ff-divergence by inserting a learnable, monotone LL-Lipschitz transform τ\tau (Tighter-VR), and (ii) selects the divergence family adaptively from data via a likelihood-based criterion. The resulting estimator yields more informative and statistically efficient discrepancy estimates while recovering prior fixed-divergence methods as special cases. Theoretically, we derive a target-risk bound whose three components are a transformed source risk, a Tighter-VR discrepancy between domains, and an ideal-hypothesis residual; we further provide finite-sample guarantees using standard complexity measures. Empirically, on Office-31, Office-Home, Digits, and VisDA-2017, our method consistently improves accuracy over strong baselines, showing that coupling Tighter-VR with adaptive divergence selection is useful for UDA.