Non-Verbal Auditory Input for Controlling Binary, Discrete, and Continuous Input in Automotive User Interfaces
Markus Funk, Vanessa Tobisch, Adam Emfield
Abstract
Using auditory input while driving is becoming increasingly popular for making distraction-free inputs while driving. However, we argue that auditory input is more than just using speech. Thus, in this work, we explore using Non-Verbal Auditory Input (NVAI) for interacting with smart assistants while driving. Through an online study with 100 participants, we initially investigated users' input preferences for binary, discrete, and continuous data types. After identifying the top three modalities for NVAI, we subsequently conducted an in-person study with 16 participants. In our study, the participants tested these input modalities for three different input data types regarding their accuracy, driver-distraction, and social acceptability, while operating a driving simulator. The results reveal that, although clapping hands for making input was initially preferred in our online survey, it is snapping fingers for binary input and discrete input and humming for making continuous input that is the preferred NVAI modality while driving.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get 51255cac-149d-4cd9-8c96-a030bc2a4f35Cited by top-tier papers6
- A Design Space for Human Sensor and Actuator Focused In-Vehicle Interaction Based on a Systematic Literature ReviewPascal Jansen, Mark Colley, Enrico RukzioUbiComp 2022 · 44 citations
- AutoVis: Enabling Mixed-Immersive Analysis of Automotive User Interface Interaction StudiesPascal Jansen, Julian Britten, Alexander Häusele, Thilo Segschneider et al.CHI 2023 · 38 citations
- Hummer: Text Entry by Gaze and HumRamin Hedeshy, Chandan Kumar, Raphael Menges, Steffen StaabCHI 2021 · 25 citations
- Move, Connect, Interact: Introducing a Design Space for Cross-Traffic InteractionAnnika Stampf, Markus Sasalovici, Luca-Maxim Meinhardt, Mark Colley et al.UbiComp 2024 · 5 citations
- Evaluating In-Car Tasks' Distraction Effects with Drive-In LabTuomo Kujala, Abhishek SarkarCHI 2025 · 3 citations
Related papers
- Autonomous is Not Enough: Designing Multisensory Mid-Air Gestures for Vehicle Interactions Among People with Visual ImpairmentsPaul D. S. Fink, Velin D. Dimitrov, Hiroshi Yasuda, Tiffany L. Chen et al.CHI 2023 · 28 citations
- Persistent Assistant: Seamless Everyday AI Interactions via Intent Grounding and Multimodal FeedbackHyunsung Cho, Jacqui Fashimpaur, Naveen Sendhilnathan, Jonathan Browder et al.CHI 2025 · 10 citations
- Evaluating Singing for Computer Input Using Pitch, Interval, and MelodyGraeme Zinck, Daniel VogelCHI 2022 · 1 citation
- In-vehicle Performance and Distraction for Midair and Touch Directional GesturesArman Hafizi, Jay Henderson, Ali Neshati, Wei Zhou et al.CHI 2023 · 7 citations
- Voice+Tactile: Augmenting In-vehicle Voice User Interface with Tactile Touchpad InteractionJin Gun Jung, Sangyoon Lee, Jiwoo Hong, Eunhye Youn et al.CHI 2020 · 37 citations
