From Failures to Fixes: LLM-Driven Scenario Repair for Self-Evolving Autonomous Driving
Xinyu Xia, Xingjun Ma, Yunfeng Hu, Ting Qu, Hong Chen, Xun Gong
Abstract
Ensuring robust and generalizable autonomous driving requires not only broad scenario coverage but also efficient repair of failure cases, particularly those related to challenging and safety-critical scenarios. However, existing scenario generation and selection methods often lack adaptivity and semantic relevance, limiting their impact on performance improvement. In this paper, we propose SERA, an LLM-powered framework that enables autonomous driving systems to self-evolve by repairing failure cases through targeted scenario recommendation. By analyzing performance logs, SERA identifies failure patterns and dynamically retrieves semantically aligned scenarios from a structured bank. An LLM-based reflection mechanism further refines these recommendations to maximize relevance and diversity. The selected scenarios are used for few-shot fine-tuning, enabling targeted adaptation with minimal data. Experiments on the benchmark show that SERA consistently improves key metrics across multiple autonomous driving baselines, demonstrating its effectiveness and generalizability under safety-critical conditions.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 0b0841ac-d6b2-4678-96f0-a3f2011e83f1Builds on8
- Frustratingly Simple Few-Shot Object DetectionXin Wang, Thomas E. Huang, Joseph Gonzalez, Trevor Darrell et al.ICML 2020 · 723 citations
- VAD: Vectorized Scene Representation for Efficient Autonomous DrivingBo Jiang, Shaoyu Chen, Qing Xu, Bencheng Liao et al.ICCV 2023 · 602 citations
- Trajectory-guided Control Prediction for End-to-end Autonomous Driving: A Simple yet Strong BaselinePenghao Wu, Xiaosong Jia, Li Chen, Junchi Yan et al.NeurIPS 2022 · 444 citations
- VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic PlanningBo Jiang, Shaoyu Chen, Hao Gao, Bencheng Liao et al.ICLR 2026 · 259 citations
- TrajCLIP: Pedestrian trajectory prediction method using contrastive learning and idempotent networksPengfei Yao, Yinglong Zhu, Huikun Bi, Tianlu Mao et al.NeurIPS 2024 · 15 citations
Related papers
- Fixed-Point Guided ADS Scenario Generation via Multi-modal LLM Reasoning and Software TestingXudong Zhang, Shihao Zhu, Yan CaiISSTA 2026
- FIXDRIVE: Automatically Repairing Autonomous Vehicle Driving Behaviour for $0.08 per ViolationYang Sun, Christopher M. Poskitt, Kun Wang, Jun SunICSE 2025 · 3 citations
- VILTA: A VLM-in-the-Loop Adversary for Enhancing Driving Policy RobustnessQimao Chen, Fang Li, Shaoqing Xu, Zhiyi Lai et al.AAAI 2026 · 2 citations
- Unleashing VLA Potentials in Autonomous Driving via Explicit Learning from FailuresYuechen Luo, Fang Li, Qimao Chen, Shaoqing Xu et al.CVPR 2026 · 21 citations
- LeGEND: A Top-Down Approach to Scenario Generation of Autonomous Driving Systems Assisted by Large Language ModelsShuncheng Tang, Zhenya Zhang, Jixiang Zhou, Lei Lei et al.ASE 2024 · 17 citations
