Lune

ASE2025Top-tier venue

ADPerf: Investigating and Testing Performance in Autonomous Driving Systems

Tri Minh-Triet Pham, Diego Elias Costa, Weiyi Shang, Jinqiu Yang

Abstract

Obstacle detection is crucial to the operation of autonomous driving systems, which rely on multiple sensors, such as cameras and LiDARs, combined with code logic and deep learning models to detect obstacles for time-sensitive decisions. Consequently, obstacle detection latency is critical to the safety and effectiveness of autonomous driving systems. However, the latency of the obstacle detection module and its resilience to various changes in the LiDAR point cloud data are not yet fully understood. In this work, we present the first comprehensive investigation on measuring and modeling the performance of the obstacle detection modules in two industry-grade autonomous driving systems, i.e., Apollo and Autoware. Learning from this investigation, we introduce ADPerf, a tool that aims to generate realistic point cloud data test cases that can expose increased detection latency. Increasing latency decreases the availability of the detected obstacles and stresses the capabilities of subsequent modules in autonomous driving systems, i.e., the modules may be negatively impacted by the increased latency in obstacle detection. We applied ADPerf to stress-test the performance of widely used 3D obstacle detection modules in autonomous driving systems, as well as the propagation of such tests on trajectory prediction modules. Our evaluation highlights the need to conduct performance testing of obstacle detection components, especially 3D obstacle detection, as they can be a major bottleneck to increased latency of the autonomous driving system. Such an adverse outcome will also further propagate to other modules, reducing the overall reliability of autonomous driving systems.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

Questions to start from

Lune can draw on

the full paper · related work

Get the answer

Free to start. No credit card required.

Lineage

  • On Adversarial Robustness of Trajectory Prediction for Autonomous Vehicles cites Adversarial Sensor Attack on LiDAR-based Perception in Autonomous Driving
  • Fooling LiDAR Perception via Adversarial Trajectory Perturbation cites Adversarial Sensor Attack on LiDAR-based Perception in Autonomous Driving
  • Invisible for both Camera and LiDAR: Security of Multi-Sensor Fusion based Perception in Autonomous Driving Under Physical-World Attacks cites Adversarial Sensor Attack on LiDAR-based Perception in Autonomous Driving
Builds onCited byLeft to right by year; the more cited, the higher.

Builds on17

  1. Adversarial Sensor Attack on LiDAR-based Perception in Autonomous DrivingYulong Cao, Chaowei Xiao, Benjamin Cyr, Yimeng Zhou et al.CCS 2019 · 626 citations
  2. Invisible for both Camera and LiDAR: Security of Multi-Sensor Fusion based Perception in Autonomous Driving Under Physical-World AttacksYulong Cao, Ningfei Wang, Chaowei Xiao, Dawei Yang et al.S&P 2021 · 309 citations
  3. Stochastic Trajectory Prediction via Motion Indeterminacy DiffusionTianpei Gu, Guangyi Chen, Junlong Li, Chunze Lin et al.CVPR 2022 · 261 citations
  4. On Adversarial Robustness of Trajectory Prediction for Autonomous VehiclesQingzhao Zhang, Shengtuo Hu, Jiachen Sun, Qi Alfred Chen et al.CVPR 2022 · 132 citations
  5. Fooling LiDAR Perception via Adversarial Trajectory PerturbationYiming Li, Congcong Wen, Felix Juefei-Xu, Chen FengICCV 2021 · 69 citations

Related papers

  1. On the Robustness Evaluation of 3D Obstacle Detection Against Specifications in Autonomous DrivingTri Minh-Triet Pham, Bo Yang, Jinqiu YangASE 2025 · 1 citation
  2. You Can't See Me: Physical Removal Attacks on LiDAR-based Autonomous Vehicles Driving FrameworksYulong Cao, S. Hrushikesh Bhupathiraju, Pirouz Naghavi, Takeshi Sugawara et al.USENIX Security 2023
  3. Exorcising "Wraith": Protecting LiDAR-based Object Detector in Automated Driving System from Appearing AttacksQifan Xiao, Xudong Pan, Yifan Lu, Mi Zhang et al.USENIX Security 2023
  4. Physically Realizable Adversarial Examples for LiDAR Object DetectionJames Tu, Mengye Ren, Sivabalan Manivasagam, Ming Liang et al.CVPR 2020
  5. SlowLiDAR: Increasing the Latency of LiDAR-Based Detection Using Adversarial ExamplesHan Liu, Yuhao Wu, Zhiyuan Yu, Yevgeniy Vorobeychik et al.CVPR 2023
Dusk over the sea between two cliffs drawn in fine vertical lines