Leveraging Similar Users for Personalized Language Modeling with Limited Data
Charles Welch, Chenxi Gu, Jonathan K. Kummerfeld, Verónica Pérez-Rosas, Rada Mihalcea
摘要
Personalized language models are designed and trained to capture language patterns specific to individual users. This makes them more accurate at predicting what a user will write. However, when a new user joins a platform and not enough text is available, it is harder to build effective personalized language models. We propose a solution for this problem, using a model trained on users that are similar to a new user. In this paper, we explore strategies for finding the similarity between new users and existing ones and methods for using the data from existing users who are a good match. We further explore the trade-off between available data for new users and how well their language can be modeled.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper7
- Large Language Models Empowered Personalized Web AgentsHongru Cai, Yongqi Li, Wenjie Wang, Fengbin Zhu 等WWW 2025 · 被引用 62 次
- Towards Unified Multi-Modal Personalization: Large Vision-Language Models for Generative Recommendation and BeyondTianxin Wei, Bowen Jin, Ruirui Li, Hansi Zeng 等ICLR 2024 · 被引用 46 次
- Crafting Personalized Agents through Retrieval-Augmented Generation on Editable Memory GraphsZheng Wang, Zhongyang Li, Zeren Jiang, Dandan Tu 等EMNLP 2024 · 被引用 6 次
- Unifying Data Perspectivism and Personalization: An Application to Social NormsJoan Plepi, Béla Neuendorf, Lucie Flek, Charles WelchEMNLP 2022 · 被引用 4 次
- From Word Sequences to Behavioral Sequences: Adapting Modeling and Evaluation Paradigms for Longitudinal NLPAdithya V. Ganesan, Vasudha Varadarajan, Oscar N. E. Kjell, Whitney Ringwald 等ACL 2026 · 被引用 3 次
它引用的顶会 Paper5
- Learning Architectures from an Extended Search Space for Language ModelingYinqiao Li, Chi Hu, Yuhao Zhang, Nuo Xu 等ACL 2020 · 被引用 12 次
- Refocusing on Relevance: Personalization in NLGShiran Dudy, Steven Bedrick, Bonnie WebberEMNLP 2021 · 被引用 2 次
- Compositional Demographic Word EmbeddingsCharles Welch, Jonathan K. Kummerfeld, Verónica Pérez-Rosas, Rada MihalceaEMNLP 2020
- Selecting Informative Contexts Improves Language Model Fine-tuningRichard J. Antonello, Nicole Beckage, Javier Turek, Alexander HuthACL 2021
- Dynamic Contextualized Word EmbeddingsValentin Hofmann, Janet B. Pierrehumbert, Hinrich SchützeACL 2021
相关 Paper
- Learning from My Friends: Few-Shot Personalized Conversation Systems via Social NetworksZhiliang Tian, Wei Bi, Zihan Zhang, Dongkyu Lee 等AAAI 2021 · 被引用 12 次
- Scaling Laws for Forgetting during Finetuning with Pretraining Data InjectionLouis Béthune, David Grangier, Dan Busbridge, Eleonora Gualdoni 等ICML 2025
- LLMs + Persona-Plug = Personalized LLMsJiongnan Liu, Yutao Zhu, Shuting Wang, Xiaochi Wei 等ACL 2025 · 被引用 19 次
- Future Language Modeling from Temporal Document HistoryChangmao Li, Jeffrey FlaniganICLR 2024
- Generalization through Memorization: Nearest Neighbor Language ModelsUrvashi Khandelwal, Omer Levy, Dan Jurafsky, Luke Zettlemoyer 等ICLR 2020 · 被引用 1,038 次
