What Did My Car Say? Impact of Autonomous Vehicle Explanation Errors and Driving Context On Comfort, Reliance, Satisfaction, and Driving Confidence
Robert A. Kaufman, Aaron Broukhim, David Kirsh, Nadir Weibel
Abstract
Explanations for autonomous vehicle (AV) decisions may build trust, however, explanations can contain errors. In a simulated driving study (n = 232), we tested how AV explanation errors, driving context characteristics (perceived harm and driving difficulty), and personal traits (prior trust and expertise) affected a passenger's comfort in relying on an AV, preference for control, confidence in the AV's ability, and explanation satisfaction. Errors negatively affected all outcomes. Surprisingly, despite identical driving, explanation errors reduced ratings of the AV's driving ability. Severity and potential harm amplified the negative impact of errors. Contextual harm and driving difficulty directly impacted outcome ratings and influenced the relationship between errors and outcomes. Prior trust and expertise were positively associated with outcome ratings. Results emphasize the need for accurate, contextually adaptive, and personalized AV explanations to foster trust, reliance, satisfaction, and confidence. We conclude with design, research, and deployment recommendations for trustworthy AV explanation systems.
• Human-centered computing → Empirical studies in HCI; User studies.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f703d3cf-dac7-4831-b6d3-b99c068b5bceCited by top-tier papers1
Ask how each one uses itBuilds on6
- Explanations Can Reduce Overreliance on AI Systems During Decision-MakingHelena Vasconcelos, Matthew Jörke, Madeleine Grunde-McLaughlin, Tobias Gerstenberg et al.CSCW 2023 · 362 citations
- The Who in XAI: How AI Background Shapes Perceptions of AI ExplanationsUpol Ehsan, Samir Passi, Q. Vera Liao, Larry Chan et al.CHI 2024 · 121 citations
- Effects of Semantic Segmentation Visualization on Trust, Situation Awareness, and Cognitive Load in Highly Automated VehiclesMark Colley, Benjamin Eder, Jan Ole Rixen, Enrico RukzioCHI 2021 · 100 citations
- Little Road Driving HUD: Heads-Up Display Complexity Influences Drivers' Perceptions of Automated VehiclesRebecca Currano, So Yeon Park, Dylan James Moore, Kent Lyons et al.CHI 2021 · 68 citations
- What and When to Explain?: On-road Evaluation of Explanations in Highly Automated VehiclesGwangbin Kim, Dohyeon Yeo, Taewoo Jo, Daniela Rus et al.UbiComp 2023 · 34 citations
Related papers
- What Do People Want to Know about Artificial Intelligence (AI)? The Importance of Answering End-user Questions to Explain Autonomous Vehicle (AV) DecisionsSomayeh Molaei, Lionel Peter Robert, Nikola BanovicCSCW 2025 · 2 citations
- ExplAIn Yourself! Transparency for Positive UX in Autonomous DrivingTobias Schneider, Joana Hois, Alischa Rosenstein, Sabiha Ghellal et al.CHI 2021 · 74 citations
- Effects of Scene Detection, Scene Prediction, and Maneuver Planning Visualizations on Trust, Situation Awareness, and Cognitive Load in Highly Automated VehiclesMark Colley, Max Rädler, Jonas Glimmann, Enrico RukzioUbiComp 2022 · 66 citations
- When to Explain: Modeling User Need for Explanations in Real-World Autonomous DrivingShihong Ling, Yaohan Ding, Yu Liu, Yue Wan et al.CHI 2026 · 1 citation
- Watch Out for Updates: Understanding the Effects of Model Explanation Updates in AI-Assisted Decision MakingXinru Wang, Ming YinCHI 2023 · 34 citations
