Verbalizing LightGCN: Direct Learning of Textual Representations from User-Item Interaction Graph via LLMs
Manh-Khanh Ngo Huu, Hady W. Lauw
Abstract
In this work, we propose VerbaLightGCN, a novel LLM-based recommendation framework that integrates the semantic understanding of LLMs with user-item interaction modeling. Traditional collaborative filtering (CF) models typically embed user and item IDs into a latent space to capture interaction signals. However, pretrained LLMs cannot natively interpret these learned embeddings. To bridge this gap, VerbaLightGCN adopts a CF-as-text paradigm, in which collaborative signals are encoded in textual form and directly learned from the user–item interaction graph, and are then combined with semantic information to construct user and item profiles that function as latent embeddings. Inspired by LightGCN, our method retains its message-passing design but replaces numerical embedding computations with a Chain-of-Thought prompting mechanism. This enables LLMs to simulate the LightGCN aggregation process through natural language. The result is a recommendation framework that unifies semantic understanding with collaborative signals in a fully language-native form. Experiments show that VerbaLightGCN achieves superior performance to both zero-shot LLM-based and traditional CF-based baselines. Further analysis reveals that the user and item profiles generated by VerbaLightGCN effectively capture both semantic preferences and collaborative filtering signals.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get b0e58249-b283-4572-b852-bfcf89957d7eRelated papers
- LLM2Rec: Large Language Models Are Powerful Embedding Models for Sequential RecommendationYingzhi He, Xiaohao Liu, An Zhang, Yunshan Ma et al.KDD 2025 · 2 citations
- PepRec: Progressive Enhancement of Prompting for RecommendationYakun Yu, Shiang Qi, Baochun Li, Di NiuEMNLP 2024 · 2 citations
- Large Language Models meet Collaborative Filtering: An Efficient All-round LLM-based Recommender SystemSein Kim, Hongseok Kang, Seungyoon Choi, Donghyun Kim et al.KDD 2024 · 107 citations
- EasyRec: Simple yet Effective Language Models for RecommendationXubin Ren, Chao HuangEMNLP 2025
- Dynamic Routing-Based Adaptive Multi-LLM Collaboration: A Unified Recommendation Framework with Decision Knowledge ComplementationJiale Huang, Yingyuan Xiao, Likang Wu, Xu Cheng et al.WWW 2026
