Sharpness-aware Model Merging with Salience Recovery for LLM-based Cross-Domain Sequential Recommendation
Huwei Ji, Jiajie Su, Yuyuan Li, Xiaohua Feng, Chaochao Chen
摘要
LLM-based Cross-Domain Sequential Recommendation (CDSR) leverages LLMs to enhance target performance via deep semantic reasoning, alleviating the dependency on overlapping users. Among LLM-based paradigms, model merging is particularly promising for multi-domain scenarios due to its superior scalability and flexibility in integrating diverse knowledge sources. However, our empirical investigations reveal two critical bottlenecks: (1) cross-domain knowledge conflict; and (2) performance saturation in multi-domain fusion. Our analysis attributes these phenomena to parameter-level misalignment and statistical homogenization during the merging process. To address these bottlenecks, we propose SharpRec, Sharpness-aware Model Merging with Salience Recovery for LLM-based CDSR, a framework designed to lift the performance upper bound of merged models. SharpRec incorporates two synergistic modules: Sharpness-aware Geometric Alignment to establish a stable geometric foundation for interference-free fusion; and Preference Salience Activation to effectively recover the distinctive features essential for bolstering target domain performance. Extensive experiments in both dual-domain and multi-domain scenarios demonstrate that SharpRec consistently outperforms state-of-the-art baselines.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper23
- Rethinking Cross-Domain Sequential Recommendation under Open-World AssumptionsWujiang Xu, Qitian Wu, Runzhong Wang, Mingming Ha 等WWW 2024 · 被引用 55 次
- eCeLLM: Generalizing Large Language Models for E-commerce from Large-scale, High-quality Instruction DataBo Peng, Xinyi Ling, Ziru Chen, Huan Sun 等ICML 2024 · 被引用 53 次
- PLATE: A Prompt-Enhanced Paradigm for Multi-Scenario RecommendationsYuhao Wang, Xiangyu Zhao, Bo Chen, Qidong Liu 等SIGIR 2023 · 被引用 50 次
- AutoTransfer: Instance Transfer for Cross-Domain RecommendationsJingtong Gao, Xiangyu Zhao, Bo Chen, Fan Yan 等SIGIR 2023 · 被引用 28 次
- Bridging Items and Language: A Transition Paradigm for Large Language Model-Based RecommendationXinyu Lin, Wenjie Wang, Yongqi Li, Fuli Feng 等KDD 2024 · 被引用 27 次
相关 Paper
- WeaveRec: An LLM-Based Cross-Domain Sequential Recommendation Framework with Model MergingMin Hou, Xin Liu, Le Wu, Chenyi He 等WWW 2026 · 被引用 1 次
- Bridge the Domains: Large Language Models Enhanced Cross-domain Sequential RecommendationQidong Liu, Xiangyu Zhao, Yejing Wang, Zijian Zhang 等SIGIR 2025 · 被引用 21 次
- DDGHM: Dual Dynamic Graph with Hybrid Metric Training for Cross-Domain Sequential RecommendationXiaolin Zheng, Jiajie Su, Weiming Liu, Chaochao ChenACM MM 2022 · 被引用 63 次
- LLM-EDT: Large Language Models Enhanced Cross-domain Sequential Recommendation with Dual-phase TrainingZiwei Liu, Qidong Liu, Wanyu Wang, Yejing Wang 等SIGIR 2026
- Multi-Domain Enhancement via Residual Interwoven Transfer in Cross-Domain Sequential RecommendationQingtian Bian, Tieying Li, Marcus Vinícius de Carvalho, Jiaxing Xu 等ACM MM 2025
