EmoWear: Exploring Emotional Teasers for Voice Message Interaction on Smartwatches
Pengcheng An, Jiawen Stefanie Zhu, Zibo Zhang, Yifei Yin, Qingyuan Ma, Che Yan, Linghao Du, Jian Zhao
Abstract
Voice messages, by nature, prevent users from gauging the emotional tone without fully diving into the audio content. This hinders the shared emotional experience at the pre-retrieval stage. Research scarcely explored “Emotional Teasers”—pre-retrieval cues offering a glimpse into an awaiting message’s emotional tone without disclosing its content. We introduce EmoWear, a smartwatch voice messaging system enabling users to apply 30 animation teasers on message bubbles to reflect emotions. EmoWear eases senders’ choice by prioritizing emotions based on semantic and acoustic processing. EmoWear was evaluated in comparison with a mirroring system using color-coded message bubbles as emotional cues (N=24). Results showed EmoWear significantly enhanced emotional communication experience in both receiving and sending messages. The animated teasers were considered intuitive and valued for diverse expressions. Desirable interaction qualities and practical implications are distilled for future design. We thereby contribute both a novel system and empirical knowledge concerning emotional teasers for voice messaging.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 02f66ac3-2d25-49b6-9309-16b2356b17b6Cited by top-tier papers6
- Chatbots for Data Collection in Surveys: A Comparison of Four Theory-Based Interview ProbesRune Møberg Jacobsen, Samuel Rhys Cox, Carla F. Griggio, Niels van BerkelCHI 2025 · 26 citations
- Feasibility and Utility of Multimodal Micro Ecological Momentary Assessment on a SmartwatchHa Le, Veronika Potter, Rithika Lakshminarayanan, Varun Mishra et al.CHI 2025 · 11 citations
- SpeechCap: Leveraging Playful Impact Captions to Facilitate Interpersonal Communication in Social Virtual RealityYu Zhang, Yi Wen, Siying Hu, Zhicong LuCSCW 2025 · 6 citations
- Remini: Leveraging Chatbot-Mediated Mutual Reminiscence for Promoting Positive Affect and Feeling of Connectedness among Loved OnesZhuoqun Jiang, ShunYi Yeo, Wei Xuan Donovan Seow, Simon Tangi PerraultCSCW 2025 · 5 citations
- Chaplains' Reflections on the Design and Usage of AI for Conversational CareJoel Wester, Samuel Rhys Cox, Henning Pohl, Niels van BerkelCHI 2026 · 3 citations
Builds on15
- Significant Otter: Understanding the Role of Biosignals in CommunicationFannie Liu, Chunjong Park, Yu Jiang Tham, Tsung-Yu Tsai et al.CHI 2021 · 67 citations
- ThermalWear: Exploring Wearable On-chest Thermal Displays to Augment Voice Messages with AffectAbdallah El Ali, Xingyu Yang, Swamy Ananthanarayan, Thomas Röggla et al.CHI 2020 · 61 citations
- Kineticharts: Augmenting Affective Expressiveness of Charts in Data Stories with Animation DesignXingyu Lan, Yang Shi, Yanqiu Wu, Xiaohan Jiao et al.IEEE VIS 2021 · 61 citations
- Visualization of Speech Prosody and Emotion in Captions: Accessibility for Deaf and Hard-of-Hearing UsersCaluã de Lacerda Pataca, Matthew Watkins, Roshan L. Peiris, Sooyeon Lee et al.CHI 2023 · 39 citations
- EmoBalloon - Conveying Emotional Arousal in Text Chats with Speech BalloonsToshiki Aoki, Rintaro Chujo, Katsufumi Matsui, Saemi Choi et al.CHI 2022 · 38 citations
Related papers
- Do Smart Glasses Dream of Sentimental Visions?: Deep Emotionship Analysis for Eyewear DevicesYingying Zhao, Yuhu Chang, Yutian Lu, Yujiang Wang et al.UbiComp 2022 · 18 citations
- HapEmoji: Enhancing Emotional Experiences in Remote Collaboration through Haptic CommunicationZhou Fang, Liwen He, Ran Zhao, Yun WangCSCW 2025 · 1 citation
- Feeling the Temperature of the Room: Unobtrusive Thermal Display of Engagement during Group CommunicationLuke Haliburton, Svenja Yvonne Schött, Linda Hirsch, Robin Welsch et al.UbiComp 2023 · 18 citations
- Teardrop Glasses: Pseudo Tears Induce Sadness in You and Those Around YouShigeo Yoshida, Takuji Narumi, Tomohiro Tanikawa, Hideaki Kuzuoka et al.CHI 2021 · 10 citations
- Tactile Emotions: Multimodal Affective Captioning with Haptics Improves Narrative Engagement for d/Deaf and Hard-of-Hearing ViewersCaluã de Lacerda Pataca, Saad Hassan, Lloyd May, Michelle M. Olson et al.CHI 2025 · 16 citations
