Lune

NeurIPS2025Top-tier venue

RAD: Training an End-to-End Driving Policy via Large-Scale 3DGS-based Reinforcement Learning

Hao Gao, Shaoyu Chen, Bo Jiang, Bencheng Liao, Yiang Shi, Xiaoyang Guo, Yuechuan Pu, Haoran Yin, Xiangyu Li, Xinbang Zhang, Ying Zhang, Wenyu Liu

Abstract

Existing end-to-end autonomous driving (AD) algorithms typically follow the Imitation Learning (IL) paradigm, which faces challenges such as causal confusion and an open-loop gap. In this work, we propose RAD, a 3DGS-based closed-loop Reinforcement Learning (RL) framework for end-to-end Autonomous Driving. By leveraging 3DGS techniques, we construct a photorealistic digital replica of the real physical world, enabling the AD policy to extensively explore the state space and learn to handle out-of-distribution scenarios through large-scale trial and error. To enhance safety, we design specialized rewards to guide the policy in effectively responding to safety-critical events and understanding real-world causal relationships. To better align with human driving behavior, we incorporate IL into RL training as a regularization term. We introduce a closed-loop evaluation benchmark consisting of diverse, previously unseen 3DGS environments. Compared to IL-based methods, RAD achieves stronger performance in most closed-loop metrics, particularly exhibiting a 3x lower collision rate. Abundant closed-loop results are presented in the supplementary material. Code is available at https://github.com/hustvl/RAD for facilitating future research.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

17 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • DGGT: Feedforward 4D Reconstruction of Dynamic Driving Scenes using Unposed Images cites 3D Gaussian Splatting for Real-Time Radiance Field Rendering
  • End-to-End Driving with Online Trajectory Evaluation via BEV World Model cites VAD: Vectorized Scene Representation for Efficient Autonomous Driving
  • End-to-End Driving with Online Trajectory Evaluation via BEV World Model cites VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planning
  • VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planning cites End-to-End Driving with Online Trajectory Evaluation via BEV World Model
  • SimScale: Learning to Drive via Real-World Simulation at Scale cites End-to-End Urban Driving by Imitating a Reinforcement Learning Coach
  • SimScale: Learning to Drive via Real-World Simulation at Scale cites End-to-End Driving with Online Trajectory Evaluation via BEV World Model
  • SimScale: Learning to Drive via Real-World Simulation at Scale cites VAD: Vectorized Scene Representation for Efficient Autonomous Driving
  • SimScale: Learning to Drive via Real-World Simulation at Scale cites 3D Gaussian Splatting for Real-Time Radiance Field Rendering
  • DriveLaW: Unifying Planning and Video Generation in a Latent Driving World cites End-to-End Driving with Online Trajectory Evaluation via BEV World Model
  • DriveLaW: Unifying Planning and Video Generation in a Latent Driving World cites VAD: Vectorized Scene Representation for Efficient Autonomous Driving
  • DriveLaW: Unifying Planning and Video Generation in a Latent Driving World cites VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planning
  • AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuning cites VAD: Vectorized Scene Representation for Efficient Autonomous Driving
  • VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planning cites End-to-End Urban Driving by Imitating a Reinforcement Learning Coach
  • VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planning cites VAD: Vectorized Scene Representation for Efficient Autonomous Driving
  • VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planning cites 3D Gaussian Splatting for Real-Time Radiance Field Rendering
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers17

  1. AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-TuningZewei Zhou, Tianhui Cai, Seth Z. Zhao, Yun Zhang et al.NeurIPS 2025 · 310 citations
  2. DriveLaW: Unifying Planning and Video Generation in a Latent Driving WorldTianze Xia, Yongkang Li, Lijun Zhou, Jingfeng Yao et al.CVPR 2026 · 58 citations
  3. SimScale: Learning to Drive via Real-World Simulation at ScaleHaochen Tian, Tianyu Li, Haochen Liu, Jiazhi Yang et al.CVPR 2026 · 40 citations
  4. DGGT: Feedforward 4D Reconstruction of Dynamic Driving Scenes using Unposed ImagesXiaoxue Chen, Ziyi Xiong, Yuantao Chen, Gen Li et al.CVPR 2026 · 24 citations
  5. End-to-End Driving with Online Trajectory Evaluation via BEV World ModelYingyan Li, Yuqi Wang, Yang Liu, Jiawei He et al.ICCV 2025 · 17 citations

Builds on20

  1. An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
  2. 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 5,687 citations
  3. VAD: Vectorized Scene Representation for Efficient Autonomous DrivingBo Jiang, Shaoyu Chen, Qing Xu, Bencheng Liao et al.ICCV 2023 · 602 citations
  4. End-to-End Urban Driving by Imitating a Reinforcement Learning CoachZhejun Zhang, Alexander Liniger, Dengxin Dai, Fisher Yu et al.ICCV 2021 · 313 citations
  5. VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic PlanningBo Jiang, Shaoyu Chen, Hao Gao, Bencheng Liao et al.ICLR 2026 · 259 citations

Related papers

  1. Prioritizing Perception-Guided Self-Supervision: A New Paradigm for Causal Modeling in End-to-End Autonomous DrivingYi Huang, Zhan Qu, Lihui Jiang, Bingbing Liu et al.NeurIPS 2025 · 5 citations
  2. Pseudo-Expert Regularized Offline RL for End-to-End Autonomous Driving in Photorealistic Closed-Loop EnvironmentsChihiro Noguchi, Takaki YamamotoCVPR Findings 2026
  3. DriveDPO: Policy Learning via Safety DPO For End-to-End Autonomous DrivingShuyao Shang, Yuntao Chen, Yuqi Wang, Yingyan Li et al.NeurIPS 2025 · 49 citations
  4. RAP: 3D Rasterization Augmented End-to-End PlanningLan Feng, Yang Gao, Eloi Zablocki, Quanyi Li et al.ICLR 2026 · 47 citations
  5. DrivingSphere: Building a High-fidelity 4D World for Closed-loop SimulationTianyi Yan, Dongming Wu, Wencheng Han, Junpeng Jiang et al.CVPR 2025
Dusk over the sea between two cliffs drawn in fine vertical lines