KinVoices: Using Voices of Friends and Family in Voice Interfaces
Samantha W. T. Chan, Tamil Selvan Gunasekaran, Yun Suen Pai, Haimo Zhang, Suranga Nanayakkara
Abstract
With voice user interfaces (VUIs) becoming ubiquitous and speech synthesis technology maturing, it is possible to synthesise voices to resemble our friends and relatives (which we will collectively call 'kin') and use them on VUIs. However, designing such interfaces and investigating how the familiarity of kin voices affect user perceptions remain under-explored. Our surveys and interviews with 25 users revealed that VUIs using kin voices were perceived as more engaging, persuasive and safer yet eerier than VUIs using common virtual assistant voices. We then developed a technology probe, KinVoice, an Alexa-based VUI that was deployed in three households over two weeks. Users set reminders using KinVoice, which in turn, gave the reminders in synthesised kin voices. This was to explore users' needs, uncover challenges involved and inspire new applications. We discuss design guidelines for integrating familiar kin voices into VUIs, applications that benefit from its usage, and implications for balancing voice realism and usability with security and diversification.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 31531079-ab63-4a03-8be0-c2ef7d2d7298Cited by top-tier papers9
- Speculating on Risks of AI Clones to Selfhood and Relationships: Doppelganger-phobia, Identity Fragmentation, and Living MemoriesPatrick Yung Kang Lee, Ning F. Ma, Ig-Jae Kim, Dongwook YoonCSCW 2023 · 46 citations
- Memoro: Using Large Language Models to Realize a Concise Interface for Real-Time Memory AugmentationWazeer Deen Zulfikar, Samantha W. T. Chan, Pattie MaesCHI 2024 · 41 citations
- Dittos: Personalized, Embodied Agents That Participate in Meetings When You Are UnavailableJoanne Leong, John C. Tang, Edward Cutrell, Sasa Junuzovic et al.CSCW 2024 · 34 citations
- Leveraging AI-Generated Emotional Self-Voice to Nudge People towards their Ideal SelvesCathy Mengying Fang, Phoebe Chua, Samantha W. T. Chan, Joanne Leong et al.CHI 2025 · 23 citations
- Synthetic Human Memories: AI-Edited Images and Videos Can Implant False Memories and Distort RecollectionPat Pataranutaporn, Chayapatr Archiwaranguprok, Samantha W. T. Chan, Elizabeth F. Loftus et al.CHI 2025 · 14 citations
Builds on5
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- Choice of Voices: A Large-Scale Evaluation of Text-to-Speech Voice Quality for Long-Form ContentJulia Cambre, Jessica Colnago, Jim Maddock, Janice Y. Tsai et al.CHI 2020 · 65 citations
- Investigating User Expectations on the Roles of Family-shared AI SpeakersSunjeong Park, Youn-Kyung LimCHI 2020 · 42 citations
- Prompto: Investigating Receptivity to Prompts Based on Cognitive Load from Memory Training Conversational AgentSamantha W. T. Chan, Shardul Sapkota, Rebecca Mathews, Haimo Zhang et al.UbiComp 2021 · 28 citations
- The Crux of Voice (In)Security: A Brain Study of Speaker Legitimacy DetectionAjaya Neupane, Nitesh Saxena, Leanne M. Hirshfield, Sarah E. BrattNDSS 2019 · 7 citations
Related papers
- Speaking from Experience: Trans/Non-Binary Requirements for Voice-Activated AICami Rincón, Os Keyes, Corinne CathCSCW 2021 · 33 citations
- Experiential Qualities of Whispering with Voice AssistantsEmmi Parviainen, Marie Louise Juul SøndergaardCHI 2020 · 52 citations
- Trust in Virtual Agents: Exploring the Role of Stylization and VoiceYang Gao, Yangbin Dai, Guangtao Zhang, Honglei Guo et al.IEEE VR 2025 · 22 citations
- "A Voice that Suits the Situation": Understanding the Needs and Challenges for Supporting End-User Voice CustomizationHyeon Jeong Byeon, Chaerin Lee, Jeemin Lee, Uran OhCHI 2022 · 3 citations
- What Makes a Virtual Celebrity Agent Trustworthy in VR? Exploring the Role of Stylization and VoiceYang Gao, Yangbin Dai, Guangtao Zhang, Honglei Guo et al.IEEE VR 2026 · 1 citation
