Stable and Adaptive Fusion for Multi-domain Multi-task Recommendation
Ke Fei, Da Luo, Kangyi Lin, Zibin Zhang, Jingjing Li
摘要
Multi-Domain Multi-Task (MDMT) recommendation aims to provide personalized recommendations by leveraging information across multiple domains and tasks. However, existing methods often suffer from spurious correlations between irrelevant features and the target, leading to negative transfer. To address this, we propose a Stable and Adaptive Fusion (SAF) framework for MDMT recommendation. SAF introduces a weighted Hilbert-Schmidt Independence Criterion (HSIC) loss to decorrelate irrelevant features from the target, learning sample weights that promote stable (i.e., robust to spurious correlations) representations in both bottom and expert layers. We employ Random Fourier Features (RFF) to enable scalable computation of the HSIC loss. We further employ adaptive feature and expert gating to select these stable features, enabling the model to capture intricate cross-domain and cross-task dependencies. The learned sample weights are also used to reweight the MDMT loss during training. Experiments on large-scale datasets show that SAF outperforms state-of-the-art baselines by up to 2% in AUC. To facilitate further research, we release a new industrial dataset with 30 million interactions across 3 domains and 2 tasks, with 300 features.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper8
- Stable Prediction with Model Misspecification and Agnostic Distribution ShiftKun Kuang, Ruoxuan Xiong, Peng Cui, Susan Athey 等AAAI 2020 · 被引用 155 次
- Stable Learning via Sample ReweightingZheyan Shen, Peng Cui, Tong Zhang, Kun KuangAAAI 2020 · 被引用 155 次
- Robust Learning with the Hilbert-Schmidt Independence CriterionDaniel Greenfeld, Uri ShalitICML 2020 · 被引用 73 次
- AdaTask: A Task-Aware Adaptive Learning Rate Approach to Multi-Task LearningEnneng Yang, Junwei Pan, Ximei Wang, Haibin Yu 等AAAI 2023 · 被引用 70 次
- A Theoretical Analysis on Independence-driven Importance Weighting for Covariate-shift GeneralizationRenzhe Xu, Xingxuan Zhang, Zheyan Shen, Tong Zhang 等ICML 2022 · 被引用 36 次
相关 Paper
- Mining Stable Preferences: Adaptive Modality Decorrelation for Multimedia RecommendationJinghao Zhang, Qiang Liu, Shu Wu, Liang WangSIGIR 2023 · 被引用 8 次
- Correlative Preference Transfer with Hierarchical Hypergraph Network for Multi-Domain RecommendationZixuan Xu, Penghui Wei, Shaoguo Liu, Weimin Zhang 等WWW 2023 · 被引用 17 次
- M3oE: Multi-Domain Multi-Task Mixture-of Experts Recommendation FrameworkZijian Zhang, Shuchang Liu, Jiaao Yu, Qingpeng Cai 等SIGIR 2024 · 被引用 27 次
- Efficiently Learning Significant Fourier Feature Pairs for Statistical Independence TestingYixin Ren, Yewei Xia, Hao Zhang, Jihong Guan 等NeurIPS 2024 · 被引用 4 次
- Multi-TAP: Multi-criteria Target Adaptive Persona Modeling for Cross-domain RecommendationDaehee Kang, Yeon-Chang LeeKDD 2026
