Artificial Intimacy: Exploring Normativity and Personalization Through Fine-tuning LLM Chatbots
Mirabelle Jones, Nastasia Griffioen, Christina Neumayer, Irina Shklovski
Abstract
Fine-tuning Large Language Models (LLMs) is one response to the critique of LLMs being biased, erasing diversity, and raising ethical concerns. The Artificial Intimacy project employs artistic methods, taking personalization of chatbots to an extreme by fine-tuning LLMs on individual social media data. We find that regular GPT-3 chatbots attempt to circumvent value-laden content through flagging prompts and producing generic non-answers with variable success. While the transactional nature of such output allowed participants to make sense of responses with less personification, fine-tuned models presented value-laden, normative, and familiar personalities, resulting in strong personification as a way of making sense of the interactions. This mimicry of emotional connection resulted in a sense of artificial intimacy creating expectations for reciprocity and consideration that the models cannot express by design. As the commercialization of interactions with chatbots continues, we discuss the ethics of such emotional manipulation and its implications for personalization of LLMs.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 6b18b8f3-c615-4f04-8850-80f34501b87bCited by top-tier papers4
- Interaction Context Often Increases Sycophancy in LLMsShomik Jain, Charlotte Park, Matt Viana, Ashia Wilson et al.CHI 2026 · 12 citations
- AI and My Values: User Perceptions of LLMs' Ability to Extract, Embody, and Explain Human Values from Casual ConversationsBhada Yun, Renn Su, April Yi WangCHI 2026 · 7 citations
- Does My Chatbot Have an Agenda? Understanding Human and AI Agency in Human-Human-like Chatbot InteractionBhada Yun, Evgenia Taranova, April Yi WangCHI 2026 · 3 citations
- AI-exhibited Personality Traits Can Shape Human Self-concept through ConversationsJingshu Li, Tianqi Song, Nattapat Boonprakong, Zicheng Zhu et al.CHI 2026 · 3 citations
Builds on9
- Climbing towards NLU: On Meaning, Form, and Understanding in the Age of DataEmily M. Bender, Alexander KollerACL 2020 · 914 citations
- Aligning AI With Shared Human ValuesDan Hendrycks, Collin Burns, Steven Basart, Andrew Critch et al.ICLR 2021 · 878 citations
- Process for Adapting Language Models to Society (PALMS) with Values-Targeted DatasetsIrene Solaiman, Christy DennisonNeurIPS 2021 · 276 citations
- To Live in Their Utopia: Why Algorithmic Systems Create Absurd OutcomesAli AlkhatibCHI 2021 · 80 citations
- The Illusion of Empathy? Notes on Displays of Emotion in Human-Computer InteractionAndrea Cuadra, Maria Wang, Lynn Andrea Stein, Malte F. Jung et al.CHI 2024 · 75 citations
Related papers
- CloChat: Understanding How People Customize, Interact, and Experience Personas in Large Language ModelsJuhye Ha, Hyeon Jeon, DaEun Han, Jinwook Seo et al.CHI 2024 · 66 citations
- Exploring the Impact of Personality Traits on LLM Bias and ToxicityShuo Wang, Renhao Li, Xi Chen, Yulin Yuan et al.EMNLP 2025 · 2 citations
- Digital Companionship: Overlapping Uses of AI Companions and AI AssistantsAikaterina Manoli, Janet V. T. Pauketat, Ali Ladak, Hayoun Noh et al.CHI 2026 · 7 citations
- BIG5-CHAT: Shaping LLM Personalities Through Training on Human-Grounded DataWenkai Li, Jiarui Liu, Andy Liu, Xuhui Zhou et al.ACL 2025
- Consistently Simulating Human Personas with Multi-Turn Reinforcement LearningMarwa Abdulhai, Ryan Cheng, Donovan Clay, Tim Althoff et al.NeurIPS 2025 · 51 citations
