Domain-aware Visual Context Prompt for Multi-Source Domain Adaptation
Yuwu Lu, Haoyu Huang, Xue Hu
摘要
Leveraging pre-trained Vision-Language Models (VLMs) for downstream tasks has gained significant attention recently, particularly in Multi-Source Domain Adaptation (MSDA). However, most existing VLMs-based MSDA approaches rely on domain-specific text prompts, which struggle to capture domain-invariant representations. In addition, multiple domains in MSDA introduce significant distribution discrepancies, complicating the design of effective text prompts. To address these challenges, we propose a Domain-aware Visual Context Prompt (DVCP) method, which leverages domain-level features to bridge the domain gaps. Specifically, we design domain-aware text prompts (DTP) module that maps global visual information into the textual prompt embedding space, creating trainable text prompts that incorporate domain-level visual information. Then, we construct a domain-aware visual tuning (DVT) module that collaboratively leverages domain-level and instance-level features to align distributions across multiple domains. Extensive experiments conducted on four popular MSDA benchmarks including Office31, ImageCLEF-DA, Office-Home, and DomainNet, demonstrate the superiority of the proposed method.
问问这篇 Paper
问问你的智能体。
Lune 读过与它相关的顶会 Paper,每个回答都会注明依据哪几篇。
相关 Paper
- Prompt-Based Distribution Alignment for Unsupervised Domain AdaptationShuanghao Bai, Min Zhang, Wanqi Zhou, Siteng Huang 等AAAI 2024 · 被引用 103 次
- Distribution-Aware Prompt Tuning for Vision-Language ModelsEulrang Cho, Jooyeon Kim, Hyunwoo J. KimICCV 2023 · 被引用 54 次
- Domain-Agnostic Mutual Prompting for Unsupervised Domain AdaptationZhekai Du, Xinyao Li, Fengling Li, Ke Lu 等CVPR 2024
- MaPLe: Multi-modal Prompt LearningMuhammad Uzair Khattak, Hanoona Abdul Rasheed, Muhammad Maaz, Salman H. Khan 等CVPR 2023
- Domain Generalization in CLIP via Learning with Diverse Text PromptsChangsong Wen, Zelin Peng, Yu Huang, Xiaokang Yang 等CVPR 2025
