Sharpness-aware Model Merging with Salience Recovery for LLM-based Cross-Domain Sequential Recommendation
Huwei Ji, Jiajie Su, Yuyuan Li, Xiaohua Feng, Chaochao Chen
Abstract
LLM-based Cross-Domain Sequential Recommendation (CDSR) leverages LLMs to enhance target performance via deep semantic reasoning, alleviating the dependency on overlapping users. Among LLM-based paradigms, model merging is particularly promising for multi-domain scenarios due to its superior scalability and flexibility in integrating diverse knowledge sources. However, our empirical investigations reveal two critical bottlenecks: (1) cross-domain knowledge conflict; and (2) performance saturation in multi-domain fusion. Our analysis attributes these phenomena to parameter-level misalignment and statistical homogenization during the merging process. To address these bottlenecks, we propose SharpRec, Sharpness-aware Model Merging with Salience Recovery for LLM-based CDSR, a framework designed to lift the performance upper bound of merged models. SharpRec incorporates two synergistic modules: Sharpness-aware Geometric Alignment to establish a stable geometric foundation for interference-free fusion; and Preference Salience Activation to effectively recover the distinctive features essential for bolstering target domain performance. Extensive experiments in both dual-domain and multi-domain scenarios demonstrate that SharpRec consistently outperforms state-of-the-art baselines.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext ef50e3dc-ca98-472e-9d7d-55f83df5201fBuilds on23
- Rethinking Cross-Domain Sequential Recommendation under Open-World AssumptionsWujiang Xu, Qitian Wu, Runzhong Wang, Mingming Ha et al.WWW 2024 · 55 citations
- eCeLLM: Generalizing Large Language Models for E-commerce from Large-scale, High-quality Instruction DataBo Peng, Xinyi Ling, Ziru Chen, Huan Sun et al.ICML 2024 · 53 citations
- PLATE: A Prompt-Enhanced Paradigm for Multi-Scenario RecommendationsYuhao Wang, Xiangyu Zhao, Bo Chen, Qidong Liu et al.SIGIR 2023 · 50 citations
- AutoTransfer: Instance Transfer for Cross-Domain RecommendationsJingtong Gao, Xiangyu Zhao, Bo Chen, Fan Yan et al.SIGIR 2023 · 28 citations
- Bridging Items and Language: A Transition Paradigm for Large Language Model-Based RecommendationXinyu Lin, Wenjie Wang, Yongqi Li, Fuli Feng et al.KDD 2024 · 27 citations
Related papers
- WeaveRec: An LLM-Based Cross-Domain Sequential Recommendation Framework with Model MergingMin Hou, Xin Liu, Le Wu, Chenyi He et al.WWW 2026 · 1 citation
- Bridge the Domains: Large Language Models Enhanced Cross-domain Sequential RecommendationQidong Liu, Xiangyu Zhao, Yejing Wang, Zijian Zhang et al.SIGIR 2025 · 21 citations
- DDGHM: Dual Dynamic Graph with Hybrid Metric Training for Cross-Domain Sequential RecommendationXiaolin Zheng, Jiajie Su, Weiming Liu, Chaochao ChenACM MM 2022 · 63 citations
- LLM-EDT: Large Language Models Enhanced Cross-domain Sequential Recommendation with Dual-phase TrainingZiwei Liu, Qidong Liu, Wanyu Wang, Yejing Wang et al.SIGIR 2026
- Multi-Domain Enhancement via Residual Interwoven Transfer in Cross-Domain Sequential RecommendationQingtian Bian, Tieying Li, Marcus Vinícius de Carvalho, Jiaxing Xu et al.ACM MM 2025
