The Halting problem: Video analysis of self-driving cars in traffic
Barry Brown, Mathias Broth, Erik Vinkhuyzen
Abstract
Using publicly uploaded videos of the Waymo and Tesla FSD self-driving cars, this paper documents how self-driving vehicles still struggle with some basics of road interaction. To drive safely self-driving cars need to interact in traffic with other road users. Yet traffic is a complex, long established social domain. We focus on one core element of road interaction: when road users yield for each other. Yielding – such as by slowing down for others in traffic – involves communication between different road users to decide who will ‘go’ and who will ‘yield’. Videos of the Waymo and Tesla FSD self-driving cars show how these systems fail to both yield for others, as well as failing to go when yielded to. In discussion, we explore how these ‘problems’ illustrate both the complexity of designing for road interaction, but also how the space of physical machine/human social interactions more broadly can be designed for.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers8
- DACAPO: Accelerating Continuous Learning in Autonomous Systems for Video AnalyticsYoonsung Kim, Changhun Oh, Jinwoo Hwang, Wonung Kim et al.ISCA 2024 · 13 citations
- Opening Up Human-Robot CollaborationStuart Reeves, Hannah R. M. Pelikan, Marina N. CantaruttiCSCW 2025 · 11 citations
- The People Behind the Robots: How Wizards Wrangle Robots in Public DeploymentsHannah R. M. Pelikan, Fanjun Bu, Wendy JuCHI 2025 · 10 citations
- Watch Out! E-scooter Coming Through!: Multimodal Sensing of Mixed Traffic Use and Conflicts Through Riders' Ego-centric ViewsHiruni Nuwanthika Kegalle, Danula Hettiachchi, Jeffrey Chan, Mark Sanderson et al.UbiComp 2025 · 8 citations
- Small Talk, Big Impact? LLM-based Conversational Agents to Mitigate Passive Fatigue in Conditional Automated DrivingLewis Cockram, Yueteng Yu, Jorge Pardo, Xiaomeng Li et al.CHI 2026 · 3 citations
Builds on1
Related papers
- Emergent Road Rules In Multi-Agent Driving EnvironmentsAvik Pal, Jonah Philion, Yuan-Hong Liao, Sanja FidlerICLR 2021 · 15 citations
- "It Must Be Gesturing Towards Me": Gesture-Based Interaction between Autonomous Vehicles and PedestriansXiang Chang, Zihe Chen, Xiaoyan Dong, Yuxin Cai et al.CHI 2024 · 14 citations
- To Cooperate or Not to Cooperate: A Systematic Review and Meta-Analysis of Human Driving Behavior in Interactions with Autonomous VehiclesYilin Kou, Qian Zhou, Jianping Wang, Nancy Xiaonan YuCHI 2026
- Keep it Real: Investigating Driver-Cyclist Interaction in Real-World TrafficAmmar Al-Taie, Yasmeen Abdrabou, Shaun Alexander Macdonald, Frank E. Pollick et al.CHI 2023 · 28 citations
- Collaborative Motion Prediction via Neural Motion Message PassingYue Hu, Siheng Chen, Ya Zhang, Xiao GuCVPR 2020
