Large Language Models Enhanced Hyperbolic Space Recommender Systems
Wentao Cheng, Zhida Qin, Zexue Wu, Pengzhan Zhou, Tianyu Huang
Abstract
Large Language Models (LLMs) have attracted significant attention in recommender systems for their excellent world knowledge capabilities. However, existing methods that rely on Euclidean space struggle to capture the rich hierarchical information inherent in textual and semantic data, which is essential for capturing user preferences. The geometric properties of hyperbolic space offer a promising solution to address this issue. Nevertheless, integrating LLMs-based methods with hyperbolic space to effectively extract and incorporate diverse hierarchical information is non-trivial. To this end, we propose a model-agnostic framework, named Hy-perLLM, which extracts and integrates hierarchical information from both structural and semantic perspectives. Structurally, Hy-perLLM uses LLMs to generate multi-level classification tags with hierarchical parent-child relationships for each item. Then, tagitem and user-item interactions are jointly learned and aligned through contrastive learning, thereby providing the model with clear hierarchical information. Semantically, HyperLLM introduces a novel meta-optimized strategy to extract hierarchical information from semantic embeddings and bridge the gap between the semantic and collaborative spaces for seamless integration. Extensive experiments show that HyperLLM significantly outperforms recommender systems based on hyperbolic space and LLMs, achieving performance improvements of over 40%. Furthermore, HyperLLM not only improves recommender performance but also enhances training stability, highlighting the critical role of hierarchical information in recommender systems.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d8b3afe1-f4f1-49f7-b28f-5259631724fdCited by top-tier papers1
Ask how each one uses itBuilds on16
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- LightGCN: Simplifying and Powering Graph Convolution Network for RecommendationXiangnan He, Kuan Deng, Xiang Wang, Yan Li et al.SIGIR 2020 · 4,448 citations
- Hyperbolic Neural Networks++Ryohei Shimizu, Yusuke Mukuta, Tatsuya HaradaICLR 2021 · 791 citations
- Representation Learning with Large Language Models for RecommendationXubin Ren, Wei Wei, Lianghao Xia, Lixin Su et al.WWW 2024 · 385 citations
- HGCF: Hyperbolic Graph Convolution Networks for Collaborative FilteringJianing Sun, Zhaoyue Cheng, Saba Zuberi, Felipe Pérez et al.WWW 2021 · 159 citations
Related papers
- Hyperbolic RQ-VAE enhanced Generative Recommendation with Differential-Length Codebook StrategyAoran Zhang, Yu-Bin Yang, Yonghong YuICML 2026
- DaRec: A Disentangled Alignment Framework for Large Language Model and Recommender SystemXihong Yang, Heming Jing, Zixing Zhang, Jindong Wang et al.ICDE 2025 · 2 citations
- Large Language Models meet Collaborative Filtering: An Efficient All-round LLM-based Recommender SystemSein Kim, Hongseok Kang, Seungyoon Choi, Donghyun Kim et al.KDD 2024 · 107 citations
- Hyperbolic Interaction Model for Hierarchical Multi-Label ClassificationBoli Chen, Xin Huang, Lin Xiao, Zixin Cai et al.AAAI 2020 · 78 citations
- HyperMiner: Topic Taxonomy Mining with Hyperbolic EmbeddingYishi Xu, Dongsheng Wang, Bo Chen, Ruiying Lu et al.NeurIPS 2022 · 38 citations
