Unraveling the Effects of Synthetic Data on End-to-End Autonomous Driving
Junhao Ge, Zuhong Liu, Longteng Fan, Yifan Jiang, Jiaqi Su, Yiming Li, Zhejun Zhang, Siheng Chen
Abstract
End-to-end () autonomous driving () models require diverse, high-quality data to perform well across various driving scenarios. However, collecting large-scale realworld data is expensive and time-consuming, making highfidelity synthetic data essential for enhancing data diversity and model robustness. Existing driving simulators have significant limitations for synthetic data generation: game-engine-based simulators struggle to produce realistic sensor data, while NeRF-based and diffusion-based methods face efficiency challenges. Additionally, recent simulators designed for closed-loop evaluation provide limited interaction with other vehicles, failing to simulate complex realworld traffic dynamics. To address these issues, we introduce SceneCrafter, a realistic, interactive, and efficient AD simulator based on 3D Gaussian Splatting (3DGS). SceneCrafter not only efficiently generates realistic driving logs across diverse traffic scenarios but also enables robust closed-loop evaluation of end-to-end models. Experimental results demonstrate that SceneCrafter serves as both a Abstract reliable evaluation platform and a efficient data generator that significantly improves end-to-end model generalization. Our code will be released at https://github. com/cancaries/SceneCrafter.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 800e86ff-8ad1-4f10-afe8-0a0afd786274Cited by top-tier papers2
- X-Scene: Large-Scale Driving Scene Generation with High Fidelity and Flexible ControllabilityYu Yang, Alan Liang, Jianbiao Mei, Yukai Ma et al.NeurIPS 2025 · 22 citations
- Model-Based Policy Adaptation for Closed-Loop End-to-end Autonomous DrivingHaohong Lin, Yunzhi Zhang, Wenhao Ding, Jiajun Wu et al.NeurIPS 2025 · 11 citations
Builds on17
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 5,687 citations
- VAD: Vectorized Scene Representation for Efficient Autonomous DrivingBo Jiang, Shaoyu Chen, Qing Xu, Bencheng Liao et al.ICCV 2023 · 602 citations
- FIERY: Future Instance Prediction in Bird's-Eye View from Surround Monocular CamerasAnthony Hu, Zak Murez, Nikhil Mohan, Sofía Dudas et al.ICCV 2021 · 329 citations
- NEAT: Neural Attention Fields for End-to-End Autonomous DrivingKashyap Chitta, Aditya Prakash, Andreas GeigerICCV 2021 · 274 citations
- Vehicle trajectory prediction works, but not everywhereMohammadhossein Bahari, Saeed Saadatnejad, Ahmad Rahimi, Mohammad Shahverdikondori et al.CVPR 2022 · 65 citations
Related papers
- SplatAD: Real-Time Lidar and Camera Rendering with 3D Gaussian Splatting for Autonomous DrivingGeorg Hess, Carl Lindström, Maryam Fatemi, Christoffer Petersson et al.CVPR 2025
- Scenario Dreamer: Vectorized Latent Diffusion for Generating Driving Simulation EnvironmentsLuke Rowe, Roger Girgis, Anthony Gosselin, Liam Paull et al.CVPR 2025
- SceneGen: Learning To Generate Realistic Traffic ScenesShuhan Tan, Kelvin Wong, Shenlong Wang, Sivabalan Manivasagam et al.CVPR 2021
- StreetCrafter: Street View Synthesis with Controllable Video Diffusion ModelsYunzhi Yan, Zhen Xu, Haotong Lin, Haian Jin et al.CVPR 2025
- HorizonForge: Driving Scene Editing with Any Trajectories and Any VehiclesYifan Wang, Francesco Pittaluga, Zaid Tasneem, Chenyu You et al.CVPR 2026 · 3 citations
