"How do I make this thing smile?": An Inventory of Expressive Nonverbal Communication in Commercial Social Virtual Reality Platforms
Theresa Jean Tanenbaum, Nazely Hartoonian, Jeffrey S. Bryan
Abstract
Despite the proliferation of platforms for social Virtual Reality (VR) communicating emotional expression via an avatar remains a significant design challenge. In order to better understand the design space for expressive Nonverbal Communication (NVC) in social VR we undertook an inventory of the ten most prominent social VR platforms. Our inventory identifies the dominant design strategies for movement, facial control, and gesture in commercial VR applications, and identifies opportunities and challenges for future design and research into social expression in VR. Specifically, we highlight the paucity of interaction paradigms for facial expression and the near nonexistence of meaningful control over ambient aspects of nonverbal communication such as posture, pose, and social status.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Cited by top-tier papers8
- Digital Proxemics: Designing Social and Collaborative Interaction in Virtual EnvironmentsJulie R. Williamson, Joseph O'Hagan, John Alexis Guerra Gómez, John H. Williamson et al.CHI 2022 · 60 citations
- Bridging the Generational Gap: Exploring How Virtual Reality Supports Remote Communication Between Grandparents and GrandchildrenXiaoying Wei, Yizheng Gu, Emily Kuang, Xian Wang et al.CHI 2023 · 48 citations
- Drifting Off in Paradise: Why People Sleep in Virtual RealityMichael Yin, Robert XiaoCHI 2023 · 22 citations
- Sensible Agent: A Framework for Unobtrusive Interaction with Proactive AR AgentsGeonsun Lee, Min Xia, Nels Numan, Xun Qian et al.UIST 2025 · 15 citations
- Enhancing Social Experiences in Immersive Virtual Reality with Artificial Facial MimicryAlessandro Visconti, Davide Calandra, Federica Giorgione, Fabrizio LambertiIEEE VR 2025 · 11 citations
Related papers
- "Talking without a Voice": Understanding Non-verbal Communication in Social Virtual RealityDivine Maloney, Guo Freeman, Donghee Yvette WohnCSCW 2020 · 246 citations
- Escape From Human: An Interview Study of Social VR Players Practicing Self-Expression Through Avatars that Self-Identify as "Non-Human"Shuto Takashita, Yuji Hatada, Takuji Narumi, Masahiko InamiCHI 2026 · 3 citations
- Let's Face It: Influence of Facial Expressions on Social Presence in Collaborative Virtual RealitySimon Kimmel, Frederike Jung, Andrii Matviienko, Wilko Heuten et al.CHI 2023 · 62 citations
- Quantifying Social Connection With Verbal and Non-Verbal Behaviors in Virtual Reality ConversationsHyunchul Kim, Jeongmi LeeCHI 2025 · 4 citations
- Raise Your Eyebrows Higher: Facilitating Emotional Communication in Social Virtual Reality Through Region-Specific Facial Expression ExaggerationXueyang Wang, Sheng Zhao, Yihe Wang, Howard Ziyu Han et al.CHI 2025 · 11 citations
