A Design Space for Human Sensor and Actuator Focused In-Vehicle Interaction Based on a Systematic Literature Review
Pascal Jansen, Mark Colley, Enrico Rukzio
Abstract
Fig. 1. Anchored (white outline) and nomadic (red outline) interaction locations in a concept vehicle.
Automotive user interfaces constantly change due to increasing automation, novel features, additional applications, and user demands. While in-vehicle interaction can utilize numerous promising modalities, no existing overview includes an extensive set of human sensors and actuators and interaction locations throughout the vehicle interior. We conducted a systematic literature review of 327 publications leading to a design space for in-vehicle interaction that outlines existing and lack of work regarding input and output modalities, locations, and multimodal interaction. To investigate user acceptance of possible modalities and locations inferred from existing work and gaps unveiled in our design space, we conducted an online study (N=48). The study revealed users' general acceptance of novel modalities (e.g., brain or thermal activity) and interaction with locations other than the front (e.g., seat or table). Our work helps practitioners evaluate key design decisions, exploit trends, and explore new areas in the domain of in-vehicle interaction.
CCS Concepts: • General and reference → Surveys and overviews; • Human-centered computing → HCI theory, concepts and models; Empirical studies in HCI.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 9fa1bbba-c2c3-4b99-859f-c706a084ddefCited by top-tier papers10
- AutoVis: Enabling Mixed-Immersive Analysis of Automotive User Interface Interaction StudiesPascal Jansen, Julian Britten, Alexander Häusele, Thilo Segschneider et al.CHI 2023 · 38 citations
- OptiCarVis: Improving Automated Vehicle Functionality Visualizations Using Bayesian Optimization to Enhance User ExperiencePascal Jansen, Mark Colley, Svenja Krauß, Daniel Hirschle et al.CHI 2025 · 19 citations
- Portobello: Extending Driving Simulation from the Lab to the RoadFanjun Bu, Stacey Li, David Goedicke, Mark Colley et al.CHI 2024 · 9 citations
- Move, Connect, Interact: Introducing a Design Space for Cross-Traffic InteractionAnnika Stampf, Markus Sasalovici, Luca-Maxim Meinhardt, Mark Colley et al.UbiComp 2024 · 5 citations
- AutoTherm: A Dataset and Benchmark for Thermal Comfort Estimation Indoors and in VehiclesMark Colley, Sebastian Hartwig, Albin Zeqiri, Timo Ropinski et al.UbiComp 2024 · 4 citations
Builds on10
- Self-Determination Theory in HCI Games Research: Current Uses and Open QuestionsApril Tyack, Elisa D. MeklerCHI 2020 · 262 citations
- Keep Calm and Ride Along: Passenger Comfort and Anxiety as Physiological Responses to Autonomous Driving StylesNicole Dillen, Marko Ilievski, Edith Law, Lennart E. Nacke et al.CHI 2020 · 104 citations
- Effects of Semantic Segmentation Visualization on Trust, Situation Awareness, and Cognitive Load in Highly Automated VehiclesMark Colley, Benjamin Eder, Jan Ole Rixen, Enrico RukzioCHI 2021 · 100 citations
- DeepTake: Prediction of Driver Takeover Behavior using Multimodal DataErfan Pakdamanian, Shili Sheng, Sonia Baee, Seongkook Heo et al.CHI 2021 · 86 citations
- CARoma Therapy: Pleasant Scents Promote Safer Driving, Better Mood, and Improved Well-Being in Angry DriversDmitrijs Dmitrenko, Emanuela Maggioni, Giada Brianza, Brittany E. Holthausen et al.CHI 2020 · 67 citations
Related papers
- Emotion-aware Design in Automobiles: Embracing Technology Advancements to Enhance Human-vehicle InteractionXingtong Chen, Xia Wang, Cong Fang, Le Fang et al.CHI 2025 · 6 citations
- SwiVR-Car-Seat: Exploring Vehicle Motion Effects on Interaction Quality in Virtual Reality Automated Driving Using a Motorized Swivel SeatMark Colley, Pascal Jansen, Enrico Rukzio, Jan GugenheimerUbiComp 2022 · 50 citations
- Actions, Speech, and Looks: What Shapes How We Feel About In-Vehicle AI Assistants?Astrid Marieke Rosenthal-von der Pütten, Nikolai Bock, Dimitra Theofanou-Fülbier, Sebastian ZepfCHI 2026 · 1 citation
- Introducing ROADS: A Systematic Comparison of Remote Control Interaction Concepts for Automated Vehicles at Road WorksMark Colley, Jonathan Westhauser, Jonas Andersson, Alexander G. Mirnig et al.CHI 2025 · 2 citations
- A Design Space for Intelligent and Interactive Writing AssistantsMina Lee, Katy Ilonka Gero, John Joon Young Chung, Simon Buckingham Shum et al.CHI 2024 · 133 citations
