DARE-GRAM : Unsupervised Domain Adaptation Regression by Aligning Inverse Gram Matrices
Ismail Nejjar, Qin Wang, Olga Fink
Abstract
Unsupervised Domain Adaptation Regression (DAR) aims to bridge the domain gap between a labeled source dataset and an unlabelled target dataset for regression problems. Recent works mostly focus on learning a deep feature encoder by minimizing the discrepancy between source and target features. In this work, we present a different perspective for the DAR problem by analyzing the closed-form ordinary least square (OLS) solution to the linear regressor in the deep domain adaptation context. Rather than aligning the original feature embedding space, we propose to align the inverse Gram matrix of the features, which is motivated by its presence in the OLS solution and the Gram matrix's ability to capture the feature correlations. Specifically, we propose a simple yet effective DAR method which leverages the pseudo-inverse lowrank property to align the scale and angle in a selected subspace generated by the pseudo-inverse Gram matrix of the two domains. We evaluate our method on three domain adaptation regression benchmarks. Experimental results demonstrate that our method achieves state-of-the-art performance. Our code is available at https://github. com/ismailnejjar/DARE-GRAM .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers12
- VT-FSL: Bridging Vision and Text with LLMs for Few-Shot LearningWenhao Li, Qiangchang Wang, Xianjing Meng, Zhibin Wu et al.NeurIPS 2025 · 10 citations
- Out of the Ordinary: Spectrally Adapting Regression for Covariate ShiftBenjamin Eyre, Elliot Creager, David Madras, Vardan Papyan et al.ICML 2024 · 3 citations
- A Physics-preserved Transfer Learning Method for Differential EquationsHaoran Yang, Chuan-Xian RenNeurIPS 2025 · 1 citation
- Discretized Density-Guided Source-Free Adaptation for Continuous TargetsGezheng Xu, Qi CHEN, QIUHAO Zeng, Charles X. Ling et al.ICML 2026
- A Generalized Label Shift Perspective for Cross-Domain Gaze EstimationHaoran Yang, Xiaohui Chen, Chuan-Xian RenNeurIPS 2025
Builds on19
- Digging Into Self-Supervised Monocular Depth EstimationClément Godard, Oisin Mac Aodha, Michael Firman, Gabriel J. BrostowICCV 2019 · 2,416 citations
- 3D Human Pose Estimation with Spatial and Temporal TransformersCe Zheng, Sijie Zhu, Matías Mendieta, Taojiannan Yang et al.ICCV 2021 · 648 citations
- Larger Norm More Transferable: An Adaptive Feature Norm Approach for Unsupervised Domain AdaptationRuijia Xu, Guanbin Li, Jihan Yang, Liang LinICCV 2019 · 563 citations
- Continual Test-Time Domain AdaptationQin Wang, Olga Fink, Luc Van Gool, Dengxin DaiCVPR 2022 · 383 citations
- Domain Adaptation for Semantic Segmentation With Maximum Squares LossMinghao Chen, Hongyang Xue, Deng CaiICCV 2019 · 315 citations
Related papers
- Representation Subspace Distance for Domain Adaptation RegressionXinyang Chen, Sinan Wang, Jianmin Wang, Mingsheng LongICML 2021 · 123 citations
- The balancing principle for parameter choice in distance-regularized domain adaptationWerner Zellinger, Natalia Shepeleva, Marius-Constantin Dinu, Hamid Eghbal-zadeh et al.NeurIPS 2021 · 10 citations
- Regressive Domain Adaptation for Unsupervised Keypoint DetectionJunguang Jiang, Yifei Ji, Ximei Wang, Yufeng Liu et al.CVPR 2021
- Discriminative Adversarial Domain AdaptationHui Tang, Kui JiaAAAI 2020 · 229 citations
- Unsupervised Domain Adaptation via Structurally Regularized Deep ClusteringHui Tang, Ke Chen, Kui JiaCVPR 2020
