Stable and Adaptive Fusion for Multi-domain Multi-task Recommendation
Ke Fei, Da Luo, Kangyi Lin, Zibin Zhang, Jingjing Li
Abstract
Multi-Domain Multi-Task (MDMT) recommendation aims to provide personalized recommendations by leveraging information across multiple domains and tasks. However, existing methods often suffer from spurious correlations between irrelevant features and the target, leading to negative transfer. To address this, we propose a Stable and Adaptive Fusion (SAF) framework for MDMT recommendation. SAF introduces a weighted Hilbert-Schmidt Independence Criterion (HSIC) loss to decorrelate irrelevant features from the target, learning sample weights that promote stable (i.e., robust to spurious correlations) representations in both bottom and expert layers. We employ Random Fourier Features (RFF) to enable scalable computation of the HSIC loss. We further employ adaptive feature and expert gating to select these stable features, enabling the model to capture intricate cross-domain and cross-task dependencies. The learned sample weights are also used to reweight the MDMT loss during training. Experiments on large-scale datasets show that SAF outperforms state-of-the-art baselines by up to 2% in AUC. To facilitate further research, we release a new industrial dataset with 30 million interactions across 3 domains and 2 tasks, with 300 features.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on8
- Stable Prediction with Model Misspecification and Agnostic Distribution ShiftKun Kuang, Ruoxuan Xiong, Peng Cui, Susan Athey et al.AAAI 2020 · 155 citations
- Stable Learning via Sample ReweightingZheyan Shen, Peng Cui, Tong Zhang, Kun KuangAAAI 2020 · 155 citations
- Robust Learning with the Hilbert-Schmidt Independence CriterionDaniel Greenfeld, Uri ShalitICML 2020 · 73 citations
- AdaTask: A Task-Aware Adaptive Learning Rate Approach to Multi-Task LearningEnneng Yang, Junwei Pan, Ximei Wang, Haibin Yu et al.AAAI 2023 · 70 citations
- A Theoretical Analysis on Independence-driven Importance Weighting for Covariate-shift GeneralizationRenzhe Xu, Xingxuan Zhang, Zheyan Shen, Tong Zhang et al.ICML 2022 · 36 citations
Related papers
- Mining Stable Preferences: Adaptive Modality Decorrelation for Multimedia RecommendationJinghao Zhang, Qiang Liu, Shu Wu, Liang WangSIGIR 2023 · 8 citations
- Correlative Preference Transfer with Hierarchical Hypergraph Network for Multi-Domain RecommendationZixuan Xu, Penghui Wei, Shaoguo Liu, Weimin Zhang et al.WWW 2023 · 17 citations
- M3oE: Multi-Domain Multi-Task Mixture-of Experts Recommendation FrameworkZijian Zhang, Shuchang Liu, Jiaao Yu, Qingpeng Cai et al.SIGIR 2024 · 27 citations
- Efficiently Learning Significant Fourier Feature Pairs for Statistical Independence TestingYixin Ren, Yewei Xia, Hao Zhang, Jihong Guan et al.NeurIPS 2024 · 4 citations
- Multi-TAP: Multi-criteria Target Adaptive Persona Modeling for Cross-domain RecommendationDaehee Kang, Yeon-Chang LeeKDD 2026
