ProVoice: Designing Proactive Functionality for In-Vehicle Conversational Assistants using Multi-Objective Bayesian Optimization to Enhance Driver Experience
Josh Susak, Yifu Liu, Pascal Jansen, Mark Colley
Abstract
The next step for In-vehicle Conversational Assistants (IVCAs) will be their capability to initiate and automate proactive system interactions throughout journeys. However, diverse drivers make it challenging to design voice interventions tailored towards individual on-road expectations. This paper evaluates the effectiveness of Human-in-the-Loop (HITL) Multi-Objective Bayesian Optimization (MOBO) in design by implementing ProVoice: a Virtual Reality (VR) driving simulator integrating MOBO to investigate the effects of IVCA design variants on perceived mental demand, predictability, and usefulness. By reporting the Pareto Front from a within-subjects VR study (N=19), this paper proposes optimal design trade-offs. Follow-up analysis demonstrates MOBO's success in discovering effective intervention strategies, with reduced participant mental demand, alongside enhanced predictability and usefulness while engaging with the proactive IVCA. Implications for computational techniques in future research on proactive intervention strategies are discussed. ProVoice can extend to include alternative design parameters and driving scenarios, encouraging intervention design on a broad scale.
• Human-centered computing → Systems and tools for interaction design; Empirical studies in interaction design.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on10
- BoTorch: A Framework for Efficient Monte-Carlo Bayesian OptimizationMaximilian Balandat, Brian Karrer, Daniel R. Jiang, Samuel Daulton et al.NeurIPS 2020 · 686 citations
- Touchscreen Typing As Optimal Supervisory ControlJussi Jokinen, Aditya Acharya, Mohammad Uzair, Xinhui Jiang et al.CHI 2021 · 105 citations
- Investigating Positive and Negative Qualities of Human-in-the-Loop Optimization for Designing Interaction TechniquesLiwei Chan, Yi-Chi Liao, George B. Mo, John J. Dudley et al.CHI 2022 · 94 citations
- SwiVR-Car-Seat: Exploring Vehicle Motion Effects on Interaction Quality in Virtual Reality Automated Driving Using a Motorized Swivel SeatMark Colley, Pascal Jansen, Enrico Rukzio, Jan GugenheimerUbiComp 2022 · 50 citations
- XR-OOM: MiXed Reality driving simulation with real cars for research and designDavid Goedicke, Alexandra W. D. Bremers, Sam Lee, Fanjun Bu et al.CHI 2022 · 49 citations
Related papers
- OptiCarVis: Improving Automated Vehicle Functionality Visualizations Using Bayesian Optimization to Enhance User ExperiencePascal Jansen, Mark Colley, Svenja Krauß, Daniel Hirschle et al.CHI 2025 · 19 citations
- Improving External Communication of Automated Vehicles Using Bayesian OptimizationMark Colley, Pascal Jansen, Mugdha Keskar, Enrico RukzioCHI 2025 · 7 citations
- Actions, Speech, and Looks: What Shapes How We Feel About In-Vehicle AI Assistants?Astrid Marieke Rosenthal-von der Pütten, Nikolai Bock, Dimitra Theofanou-Fülbier, Sebastian ZepfCHI 2026 · 1 citation
- Interruptibility for In-vehicle Multitasking: Influence of Voice Task Demands and Adaptive BehaviorsAuk Kim, Jung-Mi Park, Uichin LeeUbiComp 2020 · 30 citations
- B lur D riving : Investigating How Personalized Blur Techniques Impact Drivers' Performance in Virtual RealityYuan Li, Mark Colley, Xinyue Gui, Cristian Camilo Rendon Cardona et al.UbiComp 2026
