PriorMotion: Generative Class-Agnostic Motion Prediction with Raster-Vector Motion Field Priors
Kangan Qian, Jinyu Miao, Xinyu Jiao, Ziang Luo, Zheng Fu, Yining Shi, Yunlong Wang, Kun Jiang, Diange Yang
Abstract
Reliable spatial and motion perception is essential for safe autonomous navigation. Recently, class-agnostic motion prediction on bird's-eye view (BEV) cell grids derived from LiDAR point clouds has gained significant attention. However, existing frameworks typically perform cell classification and motion prediction on a per-pixel basis, neglecting important motion field priors such as rigidity constraints, temporal consistency, and future interactions between agents. These limitations lead to degraded performance, particularly in sparse and distant regions. To address these challenges, we introduce PriorMotion, an innovative generative framework designed for class-agnostic motion prediction that integrates essential motion priors by modeling them as distributions within a structured latent space. Specifically, our method captures structured motion priors using raster-vector representations and employs a variational autoencoder with distinct dynamic and static components to learn future motion distributions in the latent space. Experiments on the nuScenes dataset demonstrate that PriorMotion outperforms state-of-the-art methods across both traditional metrics and our newly proposed evaluation criteria. Notably, we achieve improvements of approximately 15.24% in accuracy for fast-moving objects, an 3.59% increase in generalization, a reduction of 0.0163 in motion stability, and a 31.52% reduction in prediction errors in distant regions. Further validation on FMCW LiDAR sensors confirms the robustness of our approach.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 0428379a-e958-4b6c-bb5b-53a3c0f0cb65Cited by top-tier papers1
Ask how each one uses itBuilds on7
- BE-STI: Spatial-Temporal Integrated Network for Class-agnostic Motion Prediction with Bidirectional EnhancementYunlong Wang, Hongyu Pan, Jun Zhu, Yu-Huan Wu et al.CVPR 2022 · 22 citations
- Semi-supervised Class-Agnostic Motion Prediction with Pseudo Label Regeneration and BEVMixKewei Wang, Yizheng Wu, Zhiyu Pan, Xingyi Li et al.AAAI 2024 · 11 citations
- Self-Supervised Class-Agnostic Motion Prediction with Spatial and Temporal Consistency RegularizationsKewei Wang, Yizheng Wu, Jun Cen, Zhiyu Pan et al.CVPR 2024 · 3 citations
- PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object DetectionShaoshuai Shi, Chaoxu Guo, Li Jiang, Zhe Wang et al.CVPR 2020
- Center-Based 3D Object Detection and TrackingTianwei Yin, Xingyi Zhou, Philipp KrähenbühlCVPR 2021
Related papers
- BEV-MAE: Bird's Eye View Masked Autoencoders for Point Cloud Pre-training in Autonomous Driving ScenariosZhiwei Lin, Yongtao Wang, Shengxiang Qi, Nan Dong et al.AAAI 2024 · 32 citations
- MGTANet: Encoding Sequential LiDAR Points Using Long Short-Term Motion-Guided Temporal Attention for 3D Object DetectionJunho Koh, Junhyung Lee, Youngwoo Lee, Jaekyum Kim et al.AAAI 2023 · 34 citations
- Weakly Supervised Class-agnostic Motion Prediction for Autonomous DrivingRuibo Li, Hanyu Shi, Ziang Fu, Zhe Wang et al.CVPR 2023
- MotionNet: Joint Perception and Motion Prediction for Autonomous Driving Based on Bird's Eye View MapsPengxiang Wu, Siheng Chen, Dimitris N. MetaxasCVPR 2020
- Self-Supervised Pillar Motion Learning for Autonomous DrivingChenxu Luo, Xiaodong Yang, Alan L. YuilleCVPR 2021
