Perception in Plan: Coupled Perception and Planning for End-to-End Autonomous Driving
Bozhou Zhang, Jingyu Li, Nan Song, Li Zhang
摘要
End-to-end autonomous driving has achieved remarkable advancements in recent years. Existing methods primarily follow a perception–planning paradigm, where perception and planning are executed sequentially within a fully differentiable framework for planning-oriented optimization. We further advance this paradigm through a "perception-in-plan'' framework design, which integrates perception into the planning process. This design facilitates targeted perception guided by evolving planning objectives over time, ultimately enhancing planning performance. Building on this insight, we introduce VeteranAD, a coupled perception and planning framework for end-to-end autonomous driving. By incorporating multi-mode anchored trajectories as planning priors, the perception module is specifically designed to gather traffic elements along these trajectories, enabling comprehensive and targeted perception. Planning trajectories are then generated based on both the perception results and the planning priors. To make perception fully serve planning, we adopt an autoregressive strategy that progressively predicts future trajectories while focusing on relevant regions for targeted perception at each step. With this simple yet effective design, VeteranAD fully unleashes the potential of planning-oriented end-to-end methods, leading to more accurate and reliable driving behavior. Extensive experiments on the NAVSIM and Bench2Drive datasets demonstrate that our VeteranAD achieves state-of-the-art performance.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper2
- SGDrive: Scene-to-Goal Hierarchical World Cognition for Autonomous Drivingjingyu li, Junjie Wu, Dongnan Hu, Xiangkai Huang 等CVPR 2026 · 被引用 36 次
- PlannerRFT: Reinforcing Diffusion Planners through Closed-Loop and Sample-Efficient Fine-TuningHongchen Li, Tianyu Li, Jiazhi Yang, Mingyang Shang 等CVPR 2026 · 被引用 13 次
它引用的顶会 Paper13
- VAD: Vectorized Scene Representation for Efficient Autonomous DrivingBo Jiang, Shaoyu Chen, Qing Xu, Bencheng Liao 等ICCV 2023 · 被引用 602 次
- Motion Transformer with Global Intention Localization and Local Movement RefinementShaoshuai Shi, Li Jiang, Dengxin Dai, Bernt SchieleNeurIPS 2022 · 被引用 515 次
- Trajectory-guided Control Prediction for End-to-end Autonomous Driving: A Simple yet Strong BaselinePenghao Wu, Xiaosong Jia, Li Chen, Junchi Yan 等NeurIPS 2022 · 被引用 444 次
- Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object DetectionShihao Wang, Yingfei Liu, Tiancai Wang, Ying Li 等ICCV 2023 · 被引用 399 次
- SparseBEV: High-Performance Sparse 3D Object Detection from Multi-Camera VideosHaisong Liu, Yao Teng, Tao Lu, Haiguang Wang 等ICCV 2023 · 被引用 204 次
相关 Paper
- Bridging Past and Future: End-to-End Autonomous Driving with Historical Prediction and PlanningBozhou Zhang, Nan Song, Xin Jin, Li ZhangCVPR 2025
- Planning-oriented Autonomous DrivingYihan Hu, Jiazhi Yang, Li Chen, Keyu Li 等CVPR 2023
- Future-Aware End-to-End Driving: Bidirectional Modeling of Trajectory Planning and Scene EvolutionBozhou Zhang, Nan Song, Jingyu Li, Xiatian Zhu 等NeurIPS 2025 · 被引用 29 次
- ExpertAD: Enhancing Autonomous Driving Systems with Mixture of ExpertsHaowen Jiang, Xinyu Huang, You Lu, Dingji Wang 等AAAI 2026
- HiP-AD: Hierarchical and Multi-Granularity Planning with Deformable Attention for Autonomous Driving in a Single DecoderYingqi Tang, Zhuoran Xu, Zhaotie Meng, Erkang ChengICCV 2025 · 被引用 4 次
