Bridging LLM Embeddings and VAE Parameters for Disentangled Recommendation
Nhu-Thuat Tran, Hady W. Lauw
Abstract
Disentangled recommendation within the Variational Autoencoder (VAE) framework aims to capture multiple user interests. While effective, these VAEs are fundamentally constrained by their reliance on interaction data alone, lacking the rich external semantic knowledge needed to properly structure and separate latent interests. Meanwhile, Large Language Models (LLMs) excel at deriving profound user preference signals from textual data. Prevailing methods for integrating LLMs into recommendation, however, either focus on single-interest modeling or perform a shallow fusion by aligning LLM and VAE representation spaces. Thus, they fail to fundamentally shape the VAE's latent space for multi-interest learning, hindering recommendation performance. To bridge this gap, we propose to fundamentally shift the integration point: instead of aligning representation spaces, we bridge the LLM-generated embedding space directly to the VAE's parameter space. Our framework designs hypernetworks to generate parameters governing interest discovery of a disentangled VAE conditioned on LLM-derived user embeddings. This direct bridge injects rich semantic knowledge into the model's learning foundation, preserving the VAE's power for disentangled representation while dramatically enhancing its modeling capability with informative, LLM-structured priors. Extensive experiments on benchmark datasets show that our method yields significant performance gains, unveiling the untapped potential of using LLMs for disentangled recommendation.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get 36957ea9-43a5-4fe8-b8ad-25672824c9c9Related papers
- HyMiRec: A Hybrid Multi-interest Learning Framework for LLM-based Sequential RecommendationJingyi Zhou, Cheng Chen, Kai Zuo, Manjie Xu et al.WWW 2026 · 2 citations
- Pre-train, Align, and Disentangle: Empowering Sequential Recommendation with Large Language ModelsYuhao Wang, Junwei Pan, Pengyue Jia, Wanyu Wang et al.SIGIR 2025 · 8 citations
- TimeCMA: Towards LLM-Empowered Multivariate Time Series Forecasting via Cross-Modality AlignmentChenxi Liu, Qianxiong Xu, Hao Miao, Sun Yang et al.AAAI 2025 · 141 citations
- LatentCRS: A Variational EM Framework for Bridging Semantics and Behavior in LLM-based Conversational RecommendationGuanrong Li, Kuo Tian, Jinnan Qi, Qinghan Fu et al.KDD 2026 · 1 citation
- Representation Learning with Large Language Models for RecommendationXubin Ren, Wei Wei, Lianghao Xia, Lixin Su et al.WWW 2024 · 385 citations
