Reliable Policy Transfer for Safety-Aware End-to-End Driving with Deep Reinforcement Learning
Uddin Md. Borhan, Arif Raza, Zhiliang Lin, Lu Wang, Jianqiang Li, Jie Chen
摘要
End-to-End (E2E) Reinforcement Learning (RL) for autonomous driving still struggles with safety and generalization under distribution shift, as perception-heavy encoders, sparse rewards, and ad hoc uncertainty handling yield brittle closed-loop behavior. This work introduces a unified Deep RL (DRL) framework built around a controllayer reliability interface where the same uncertainty signal informs relational attention, gates policy entropy, and regularizes transfer alignment. An ego-centric relational graph encodes agent influence via uncertainty-weighted attention over kinematics, lane geometry, and semantics, producing a compact control state. A multi-objective differentiable reward shapes safety, progress, and comfort with an uncertainty term. Aleatoric and epistemic uncertainty, captured through per-edge heteroscedastic variance and a critic ensemble, modulate policy entropy for risk-aware exploration. A causal-semantic transfer objective aligns actions, attention, and uncertainty statistics across domains with meta-learned initialization for few-shot adaptation. In closed-loop urban driving across varied towns, traffic, and weather, the framework improves success rate, reduces infractions, and achieves higher time-to-conflict combined with lower lateral deviation over strong baselines.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper14
- VAD: Vectorized Scene Representation for Efficient Autonomous DrivingBo Jiang, Shaoyu Chen, Qing Xu, Bencheng Liao 等ICCV 2023 · 被引用 602 次
- DriveAdapter: Breaking the Coupling Barrier of Perception and Planning in End-to-End Autonomous DrivingXiaosong Jia, Yulu Gao, Li Chen, Junchi Yan 等ICCV 2023 · 被引用 154 次
- Hidden Biases of End-to-End Driving ModelsBernhard Jaeger, Kashyap Chitta, Andreas GeigerICCV 2023 · 被引用 130 次
- Deep Ensembles Work, But Are They Necessary?Taiga Abe, Estefany Kelly Buchanan, Geoff Pleiss, Richard S. Zemel 等NeurIPS 2022 · 被引用 101 次
- VLP: Vision Language Planning for Autonomous DrivingChenbin Pan, Burhaneddin Yaman, Tommaso Nesti, Abhirup Mallik 等CVPR 2024 · 被引用 53 次
相关 Paper
- DiffE2E: Rethinking End-to-End Driving with a Hybrid Diffusion-Regression-Classification PolicyRui Zhao, Yuze Fan, Ziguo Chen, Fei Gao 等NeurIPS 2025 · 被引用 7 次
- One Risk to Rule Them All: A Risk-Sensitive Perspective on Model-Based Offline Reinforcement LearningMarc Rigter, Bruno Lacerda, Nick HawesNeurIPS 2023 · 被引用 26 次
- Predict and Resist: Long-Term Accident Anticipation Under Sensor NoiseXingcheng Liu, Bin Rao, Yanchen Guan, Chengyue Wang 等AAAI 2026
- Raw2Drive: Reinforcement Learning with Aligned World Models for End-to-End Autonomous Driving (in CARLA v2)Zhenjie Yang, Xiaosong Jia, Qifeng Li, Xue Yang 等NeurIPS 2025 · 被引用 65 次
- Domain Adaptation In Reinforcement Learning Via Latent Unified State RepresentationJinwei Xing, Takashi Nagata, Kexin Chen, Xinyun Zou 等AAAI 2021 · 被引用 65 次
