User-Defined Co-Speech Gesture Design with Swarm Robots
Minh Duc Dang, Samira Pulatova, Lawrence H. Kim
Abstract
Non-verbal signals, including co-speech gestures, play a vital role in human communication by conveying nuanced meanings beyond verbal discourse. While researchers have explored co-speech gestures in human-like conversational agents, limited attention has been given to non-humanoid alternatives. In this paper, we propose using swarm robotic systems as conversational agents and introduce a foundational set of swarm-based co-speech gestures, elicited from non-technical users and validated through an online study. This work outlines the key software and hardware requirements to advance research in co-speech gesture generation with swarm robots, contributing to the future development of social robotics and conversational agents.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on7
- User-defined Swarm Robot ControlLawrence H. Kim, Daniel S. Drew, Veronika Domova, Sean FollmerCHI 2020 · 56 citations
- Humorous Robotic Behavior as a New Approach to Mitigating Social AwkwardnessViva Sarah Press, Hadas ErelCHI 2023 · 27 citations
- AeroRigUI: Actuated TUIs for Spatial Interaction using Rigging Swarm Robots on Ceilings in Everyday SpaceLilith Yu, Chenfeng Gao, David Wu, Ken NakagakiCHI 2023 · 21 citations
- Swarm Body: Embodied Swarm RobotsSosuke Ichihashi, So Kuroki, Mai Nishimura, Kazumi Kasaura et al.CHI 2024 · 20 citations
- ThrowIO: Actuated TUIs that Facilitate "Throwing and Catching" Spatial Interaction with Overhanging Mobile Wheeled RobotsTing-Han Lin, Willa Yunqi Yang, Ken NakagakiCHI 2023 · 18 citations
Related papers
- Shape n' Swarm: Hands-on, Shape-aware Generative Authoring with Swarm UI and LLMsMatthew Jeung, Anup Sathya, Wanli Qian, Steven Arellano et al.UIST 2025 · 1 citation
- SGToolkit: An Interactive Gesture Authoring Toolkit for Embodied Conversational AgentsYoungwoo Yoon, Keunwoo Park, Minsu Jang, Jaehong Kim et al.UIST 2021 · 20 citations
- Passing a Non-verbal Turing Test: Evaluatina Gesture Animations Generated from SpeechManuel Rebol, Christian Gütl, Krzysztof PietroszekIEEE VR 2021 · 31 citations
- An Approach to Elicit Human-Understandable Robot Expressions to Support Human-Robot InteractionJan Leusmann, Steeven Villa, Thomas Liang, Chao Wang et al.CHI 2025 · 16 citations
- SemGesture: Synthesizing Semantically Enhanced and Coherent GesturesPengsheng Liu, Zhaojie Chu, Xiaofen Xing, Xiangmin XuACM MM 2025 · 2 citations
