Leveraging AI-Generated Emotional Self-Voice to Nudge People towards their Ideal Selves
Cathy Mengying Fang, Phoebe Chua, Samantha W. T. Chan, Joanne Leong, Andria Bao, Pattie Maes
Abstract
Emotions, shaped by past experiences, significantly influence decision-making and goal pursuit. Traditional cognitive-behavioral techniques for personal development rely on mental imagery to envision ideal selves, but may be less effective for individuals who struggle with visualization. This paper introduces Emotional Self-Voice (ESV), a novel system combining emotionally expressive language models and voice cloning technologies to render customized responses in the user's own voice. We investigate the potential of ESV to nudge individuals towards their ideal selves in a study with 60 participants. Across all three conditions (ESV, text-only, and mental imagination), we observed an increase in resilience, confidence, motivation, and goal commitment, and the ESV condition was perceived as uniquely engaging and personalized. We discuss the implications of designing generated self-voice systems as a personalized behavioral intervention for different scenarios.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext b69b9cdb-7fa0-48f8-a9c7-d4bb0f48efc9Cited by top-tier papers8
- Introspectus AI: Long-term AI-Driven Dialogue Training To Promote Self-ReflectionShengyin Li, Guangyao Zhu, Danyang Peng, Ximing Shen et al.CSCW 2025 · 5 citations
- Restoration, Exploration and Transformation: How Youth Engage Character.AI for Fun, Feels and Finding themselvesAnnabel Blake, Marcus Carter, Eduardo VellosoCHI 2026 · 4 citations
- InnerPond: Fostering Inter-Self Dialogue with a Multi-Agent Approach for IntrospectionHayeon Jeon, Dakyeom Ahn, Sunyu Pang, Yunseo Choi et al.CHI 2026 · 3 citations
- Exploring the Effects of Different Chatbot Voice Identities on Self-DisclosureYamato Mogi, Wataru Akahori, Naomi YamashitaCHI 2026 · 2 citations
- Toward Natural and Companionable Virtual Agents via Cross-Temporal Emotional ModelingYi Zheng, Feier Qin, Xiao Li, Haibin Huang et al.CHI 2026 · 1 citation
Builds on9
- Joint Audio-Visual Deepfake DetectionYipin Zhou, Ser-Nam LimICCV 2021 · 232 citations
- MindfulDiary: Harnessing Large Language Model to Support Psychiatric Patients' JournalingTaewan Kim, Seolyeong Bae, Hyun Ah Kim, Su-Woo Lee et al.CHI 2024 · 112 citations
- Reflection in Theory and Reflection in Practice: An Exploration of the Gaps in Reflection Support among Personal Informatics AppsJanghee Cho, Tian Xu, Abigail Zimmermann-Niefield, Stephen VoidaCHI 2022 · 84 citations
- Gibbs Sampling with PeoplePeter M. C. Harrison, Raja Marjieh, Federico Adolfi, Pol van Rijn et al.NeurIPS 2020 · 81 citations
- KinVoices: Using Voices of Friends and Family in Voice InterfacesSamantha W. T. Chan, Tamil Selvan Gunasekaran, Yun Suen Pai, Haimo Zhang et al.CSCW 2021 · 32 citations
Related papers
- The Personalization Paradox: Trade-offs Between Social Presence and Task Efficiency in Embodied AR InstructorsAbdul Mannan Mohammed, Martin McCarthy, Carsten Neumann, Gerd Bruder et al.CHI 2026 · 3 citations
- EmoKnob: Enhance Voice Cloning with Fine-Grained Emotion ControlHaozhe Chen, Run Chen, Julia HirschbergEMNLP 2024 · 4 citations
- Social Media through Voice: Synthesized Voice Qualities and Self-presentationLotus Zhang, Lucy Jiang, Nicole Washington, Augustina Ao Liu et al.CSCW 2021 · 40 citations
- My Voice as a Daily Reminder: Self-Voice Alarm for Daily Goal AchievementJieun Kim, Hayeon SongCHI 2024 · 12 citations
- Customizing Emotional Support: How Do Individuals Construct and Interact With LLM-Powered ChatbotsXi Zheng, Zhuoyang Li, Xinning Gui, Yuhan LuoCHI 2025 · 47 citations
