Universal Source-Free Domain Adaptation
Jogendra Nath Kundu, Naveen Venkat, Rahul M. V., R. Venkatesh Babu
Abstract
There is a strong incentive to develop versatile learning techniques that can transfer the knowledge of class-separability from a labeled source domain to an unlabeled target domain in the presence of a domain-shift. Existing domain adaptation (DA) approaches are not equipped for practical DA scenarios as a result of their reliance on the knowledge of source-target label-set relationship (e.g. Closed-set, Open-set or Partial DA). Furthermore, almost all the prior unsupervised DA works require coexistence of source and target samples even during deployment, making them unsuitable for incremental, real-time adaptation. Devoid of such highly impractical assumptions, we propose a novel two-stage learning process. Initially, in the procurement-stage, the objective is to equip the model for future sourcefree deployment, assuming no prior knowledge of the upcoming category-gap and domain-shift. To achieve this, we enhance the model's ability to reject out-of-source distribution samples by leveraging the available source data, in a novel generative classifier framework. Subsequently, in the deployment-stage, the objective is to design a unified adaptation algorithm capable of operating across a wide range of category-gaps, with no access to the previously seen source samples. To achieve this, in contrast to the usage of complex adversarial training regimes, we define a simple yet effective source-free adaptation objective by utilizing a novel instancelevel weighing mechanism, named as Source Similarity Metric (SSM). A thorough evaluation shows the practical usability of the proposed learning framework with superior DA performance even over state-of-the-art source-dependent approaches.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 273776eb-1780-4763-aebf-b1f96fa57e14Cited by top-tier papers106
- Tent: Fully Test-Time Adaptation by Entropy MinimizationDequan Wang, Evan Shelhamer, Shaoteng Liu, Bruno A. Olshausen et al.ICLR 2021 · 1,731 citations
- Test-Time Prompt Tuning for Zero-Shot Generalization in Vision-Language ModelsManli Shu, Weili Nie, De-An Huang, Zhiding Yu et al.NeurIPS 2022 · 603 citations
- Efficient Test-Time Model Adaptation without ForgettingShuaicheng Niu, Jiaxiang Wu, Yifan Zhang, Yaofo Chen et al.ICML 2022 · 579 citations
- TTT++: When Does Self-Supervised Test-Time Training Fail or Thrive?Yuejiang Liu, Parth Kothari, Bastien van Delft, Baptiste Bellot-Gurlet et al.NeurIPS 2021 · 469 citations
- Test-Time Classifier Adjustment Module for Model-Agnostic Domain GeneralizationYusuke Iwasawa, Yutaka MatsuoNeurIPS 2021 · 456 citations
Related papers
- Balancing Discriminability and Transferability for Source-Free Domain AdaptationJogendra Nath Kundu, Akshay R. Kulkarni, Suvaansh Bhambri, Deepesh Mehta et al.ICML 2022 · 110 citations
- Dynamic Target Distribution Estimation for Source-Free Open-Set Domain AdaptationZhiqi Yu, Zhichao Liao, Jingjing Li, Zhi Chen et al.AAAI 2025 · 5 citations
- Diffusion-Driven Progressive Target Manipulation for Source-Free Domain AdaptationYuyang Huang, Yabo Chen, Junyu Zhou, Wenrui Dai et al.NeurIPS 2025 · 2 citations
- Upcycling Models Under Domain and Category ShiftSanqing Qu, Tianpei Zou, Florian Röhrbein, Cewu Lu et al.CVPR 2023
- GeT: Generative Target Structure Debiasing for Domain AdaptationCan Zhang, Gim Hee LeeICCV 2023 · 2 citations
