Fixed-Point Guided ADS Scenario Generation via Multi-modal LLM Reasoning and Software Testing
Xudong Zhang, Shihao Zhu, Yan Cai
Abstract
Robust scenario generation is essential for systematically testing Autonomous Driving Systems (ADSs) under rare and safety-critical conditions. However, search-based approaches often lack semantic guidance, whereas specification-based approaches rely heavily on manually constructed rules. Existing LLM-assisted techniques primarily translate accident artifacts into scene descriptions without producing executable behavioral specifications that guide subsequent testing. We present InvarGen , a framework that uses a multi-modal LLM as a parametric specification generator. InvarGen organizes safety requirements into a predefined taxonomy of Scenario Fixed Points while dynamically instantiating their predicates, thresholds, and temporal bounds from each accident context. These fixed points serve as executable test oracles and optimization objectives. Unlike static templates, these fixed points adaptively constrain the search space, guiding a hybrid evolutionary process: Intelligent Fuzzing exploits boundary parameters to trigger specific violations, while Structural Mutation ensures the global exploration of diverse environmental contexts. Evaluation using 200 real-world accidents and 1,400 synthesized scenarios shows that InvarGen discovers 37.8% more critical scenario types than the best baseline, achieves a 30% fixed-point violation rate, and achieves the highest semantic-diversity score. The scenarios also achieve high physical plausibility and cross-simulator executability, with 100% syntactic compliance with the evaluated OpenX formats. These results highlight the promise of fixed-point semantics as a principled bridge between unstructured LLM reasoning and rigorous robustness testing.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get ff42f698-eee9-46ee-b58d-89f98b37746dRelated papers
- LeGEND: A Top-Down Approach to Scenario Generation of Autonomous Driving Systems Assisted by Large Language ModelsShuncheng Tang, Zhenya Zhang, Jixiang Zhou, Lei Lei et al.ASE 2024 · 17 citations
- From Failures to Fixes: LLM-Driven Scenario Repair for Self-Evolving Autonomous DrivingXinyu Xia, Xingjun Ma, Yunfeng Hu, Ting Qu et al.ACM MM 2025 · 1 citation
- SAFE: Harnessing LLM for Scenario-Driven ADS Testing from Multimodal Crash DataSiwei Luo, Yang Zhang, Yao Deng, Linfeng Liang et al.ICSE 2026
- MG-Fuzz: Model-Guided Fuzzing for Unsafe Scenario Discovery in Autonomous Driving SystemsYulong Lyu, Ruiqi Hong, Jiawan Wang, Jun Sun et al.ISSTA 2026
- DiaVio: LLM-Empowered Diagnosis of Safety Violations in ADS Simulation TestingYou Lu, Yifan Tian, Yuyang Bi, Bihuan Chen et al.ISSTA 2024 · 9 citations
