EMNLP Findings2024
Guided Profile Generation Improves Personalization with Large Language Models
Abstract
In modern commercial systems, including Recommendation, Ranking, and E-Commerce platforms, there is a trend towards improving customer experiences by incorporating Personalization context as input into Large Language Models (LLMs). However, LLMs often struggle to effectively parse and utilize sparse and complex personal context without additional processing or contextual enrichment, underscoring the need for more sophisticated context understanding mechanisms. In this work, we propose Guided Profile Generation (GPG), a general method designed to generate personal profiles in natural language. As is observed, intermediate guided profile generation enables LLMs to summarize, and extract the important, distinctive features from the personal context into concise, descriptive sentences, precisely tailoring their generation more closely to an individual's unique habits and preferences. Our experimental results show that GPG improves LLM's personalization ability across different tasks, for example, it increases 37% accuracy in predicting personal preference compared to directly feeding the LLMs with raw personal context.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
6 top-tier papers have cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
- Personalized Generation In Large Model Era: A Survey cites BERTScore: Evaluating Text Generation with BERT
- One Adapts to Any: Meta Reward Modeling for Personalized LLM Alignment cites SynthesizeMe! Inducing Persona-Guided Prompts for Personalized Reward Models in LLMs
- One Adapts to Any: Meta Reward Modeling for Personalized LLM Alignment cites Training language models to follow instructions with human feedback
- Language Models are Few-Shot Learners cites Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
- SynthesizeMe! Inducing Persona-Guided Prompts for Personalized Reward Models in LLMs cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
- SynthesizeMe! Inducing Persona-Guided Prompts for Personalized Reward Models in LLMs cites Training language models to follow instructions with human feedback
- Chain-of-Thought Prompting Elicits Reasoning in Large Language Models cites Training language models to follow instructions with human feedback
- Training language models to follow instructions with human feedback cites Language Models are Few-Shot Learners
Cited by top-tier papers6
- Personalized Generation In Large Model Era: A SurveyYiyan Xu, Jinghao Zhang, Alireza Salemi, Xinting Hu et al.ACL 2025 · 45 citations
- Personalized Text Generation with Contrastive Activation SteeringJinghao Zhang, Yuting Liu, Wenjie Wang, Qiang Liu et al.ACL 2025 · 24 citations
- SynthesizeMe! Inducing Persona-Guided Prompts for Personalized Reward Models in LLMsMichael J. Ryan, Omar Shaikh, Aditri Bhagirath, Daniel Frees et al.ACL 2025 · 14 citations
- Instant Personalized Large Language Model Adaptation via HypernetworkZhaoxuan Tan, Zixuan Zhang, Haoyang Wen, Zheng Li et al.ACL 2026 · 7 citations
- One Adapts to Any: Meta Reward Modeling for Personalized LLM AlignmentHongru Cai, Yongqi Li, Tiezheng Yu, Fengbin Zhu et al.SIGIR 2026
Builds on14
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida et al.NeurIPS 2022 · 24,707 citations
- Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
- Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksPatrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni et al.NeurIPS 2020 · 19,162 citations
- BERTScore: Evaluating Text Generation with BERTTianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q. Weinberger et al.ICLR 2020 · 8,443 citations
Related papers
- LettinGo: Explore User Profile Generation for Recommendation SystemLu Wang, Di Zhang, Fangkai Yang, Pu Zhao et al.KDD 2025 · 2 citations
- Attn-GS: Attention-Guided Context Compression for Efficient Personalized LLMsShenglai Zeng, Tianqi Zheng, Chuan Tian, Dante Everaert et al.ACL 2026 · 1 citation
- Measuring What Makes You Unique: Difference-Aware User Modeling for Enhancing LLM PersonalizationYilun Qiu, Xiaoyan Zhao, Yang Zhang, Yimeng Bai et al.ACL Findings 2025 · 3 citations
- Personalized Question Answering with User Profile Generation and CompressionHang Su, Yun Yang, Tianyang Liu, Xin Liu et al.EMNLP Findings 2025
- PMG : Personalized Multimodal Generation with Large Language ModelsXiaoteng Shen, Rui Zhang, Xiaoyan Zhao, Jieming Zhu et al.WWW 2024 · 40 citations
