Understanding User Perceptions of Proactive Smart Speakers
Jing Wei, Tilman Dingler, Vassilis Kostakos
Abstract
Voice assistants, such as Amazon's Alexa and Google Home, increasingly find their way into consumer homes. Their functionality, however, is currently limited to being passive answer machines rather than proactively engaging users in conversations. Speakers' proactivity would open up a range of important application scenarios, including health services, such as checking in on patient states and triggering medication reminders. It remains unclear how passive speakers should implement proactivity. To better understand user perceptions, we ran a 3-week field study with 13 participants where we modified the off-the-shelf Google Home to become proactive. During the study, our speaker proactively triggered conversations that were essentially Experience Sampling probes allowing us to identify when to engage users. Applying machine-learning, we are able to predict user responsiveness with a 71.6% accuracy and find predictive features. We also identify self-reported factors, such as boredom and mood, that are significantly correlated with users' perceived availability. Our prototype and findings inform the design of proactive speakers that verbally engage users at opportune moments and contribute to the design of proactive application scenarios and voice-based experience sampling studies.
CCS Concepts: • Human-centered computing → Sound-based input / output.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 1b3a251e-8341-4f6e-9674-948f6cbd36cfCited by top-tier papers11
- Leveraging Large Language Models to Power Chatbots for Collecting User Self-Reported DataJing Wei, Sungdong Kim, Hyunhoon Jung, Young-Ho KimCSCW 2024 · 82 citations
- Polite or Direct? Conversation Design of a Smart Display for Older Adults Based on Politeness TheoryYaxin Hu, Yuxiao Qu, Adam Maus, Bilge MutluCHI 2022 · 43 citations
- Exploring Context-Aware Mental Health Self-Tracking Using Multimodal Smart Speakers in Home EnvironmentsJieun Lim, Youngji Koh, Auk Kim, Uichin LeeCHI 2024 · 29 citations
- Foody Talk: Exploring Opportunities for Conversational Food JournalingLucas M. Silva, Xi Lu, Emily X. Liang, Daniel A. EpsteinCHI 2025 · 9 citations
- Understanding How to Administer Voice Surveys through Smart SpeakersJing Wei, Weiwei Jiang, Chaofan Wang, Difeng Yu et al.CSCW 2022 · 9 citations
Builds on8
- He Is Just Like Me: A Study of the Long-Term Use of Smart Speakers by Parents and ChildrenRadhika Garg, Subhasree SenguptaUbiComp 2020 · 139 citations
- Parenting with Alexa: Exploring the Introduction of Smart Speakers on Family DynamicsErin Beneteau, Ashley Boone, Yuxing Wu, Julie A. Kientz et al.CHI 2020 · 134 citations
- Amazon vs. My Brother: How Users of Shared Smart Speakers Perceive and Cope with Privacy RisksYue Huang, Borke Obada-Obieh, Konstantin BeznosovCHI 2020 · 92 citations
- Hello There! Is Now a Good Time to Talk?: Opportune Moments for Proactive Interactions with Smart SpeakersNarae Cha, Auk Kim, Cheul Young Park, Soowon Kang et al.UbiComp 2020 · 74 citations
- TandemTrack: Shaping Consistent Exercise Experience by Complementing a Mobile App with a Smart SpeakerYuhan Luo, Bongshin Lee, Eun Kyoung ChoeCHI 2020 · 41 citations
Related papers
- What Could Possibly Go Wrong When Interacting with Proactive Smart Speakers? A Case Study Using an ESM ApplicationJing Wei, Benjamin Tag, Johanne R. Trippas, Tilman Dingler et al.CHI 2022 · 45 citations
- Interrupting for Microlearning: Understanding Perceptions and Interruptibility of Proactive Conversational Microlearning ServicesMinyeong Kim, Jiwook Lee, Youngji Koh, Chanhee Lee et al.CHI 2024 · 3 citations
- Ok Google, What Am I Doing?: Acoustic Activity Recognition Bounded by Conversational Assistant InteractionsRebecca Adaimi, Howard Yong, Edison ThomazUbiComp 2021 · 29 citations
- Better to Ask Than Assume: Proactive Voice Assistants' Communication Strategies That Respect User Agency in a Smart Home EnvironmentJeesun Oh, Wooseok Kim, Sungbae Kim, Hyeonjeong Im et al.CHI 2024 · 22 citations
- Aware: Intuitive Device Activation Using Prosody for Natural Voice InteractionsXinlei Zhang, Zixiong Su, Jun RekimotoCHI 2022 · 7 citations
