Complementary Attention Gated Network for Pedestrian Trajectory Prediction
Jinghai Duan, Le Wang, Chengjiang Long, Sanping Zhou, Fang Zheng, Liushuai Shi, Gang Hua
Abstract
Pedestrian trajectory prediction is crucial in many practical applications due to the diversity of pedestrian movements, such as social interactions and individual motion behaviors. With similar observable trajectories and social environments, different pedestrians may make completely different future decisions. However, most existing methods only focus on the frequent modal of the trajectory and thus are difficult to generalize to the peculiar scenario, which leads to the decline of the multimodal fitting ability when facing similar scenarios. In this paper, we propose a complementary attention gated network (CAGN) for pedestrian trajectory prediction, in which a dual-path architecture including normal and inverse attention is proposed to capture both frequent and peculiar modals in spatial and temporal patterns, respectively. Specifically, a complementary block is proposed to guide normal and inverse attention, which are then be summed with learnable weights to get attention features by a gated network. Finally, multiple trajectory distributions are estimated based on the fused spatio-temporal attention features due to the multimodality of future trajectory. Experimental results on benchmark datasets, i.e., the ETH, and the UCY, demonstrate that our method outperforms state-of-the-art methods by 13.8% in Average Displacement Error (ADE) and 10.4% in Final Displacement Error (FDE). Code will be available at https://github.com/jinghaiD/CAGN
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 79543876-c17e-472b-b503-d986162d993dCited by top-tier papers12
- Progressively Generating Better Initial Guesses Towards Next Stages for High-Quality Human Motion PredictionTiezheng Ma, Yongwei Nie, Chengjiang Long, Qing Zhang et al.CVPR 2022 · 150 citations
- Trajectory Unified Transformer for Pedestrian Trajectory PredictionLiushuai Shi, Le Wang, Sanping Zhou, Gang HuaICCV 2023 · 100 citations
- Multi-Stream Representation Learning for Pedestrian Trajectory PredictionYuxuan Wu, Le Wang, Sanping Zhou, Jinghai Duan et al.AAAI 2023 · 63 citations
- Diverse Human Motion Prediction via Gumbel-Softmax Sampling from an Auxiliary SpaceLingwei Dang, Yongwei Nie, Chengjiang Long, Qing Zhang et al.ACM MM 2022 · 52 citations
- Sparse Instance Conditioned Multimodal Trajectory PredictionYonghao Dong, Le Wang, Sanping Zhou, Gang HuaICCV 2023 · 30 citations
Builds on14
- STGAT: Modeling Spatial-Temporal Interactions for Human Trajectory PredictionYingfan Huang, Huikun Bi, Zhaoxin Li, Tianlu Mao et al.ICCV 2019 · 615 citations
- The Trajectron: Probabilistic Multi-Agent Trajectory Modeling With Dynamic Spatiotemporal GraphsBoris Ivanovic, Marco PavoneICCV 2019 · 473 citations
- A Hybrid Video Anomaly Detection Framework via Memory-Augmented Flow Reconstruction and Flow-Guided Frame PredictionZhian Liu, Yongwei Nie, Chengjiang Long, Qing Zhang et al.ICCV 2021 · 341 citations
- MSR-GCN: Multi-Scale Residual Graph Convolution Networks for Human Motion PredictionLingwei Dang, Yongwei Nie, Chengjiang Long, Qing Zhang et al.ICCV 2021 · 252 citations
- A Hybrid Attention Mechanism for Weakly-Supervised Temporal Action LocalizationAshraful Islam, Chengjiang Long, Richard J. RadkeAAAI 2021 · 145 citations
Related papers
- SCAN: A Spatial Context Attentive Network for Joint Multi-Agent Intent PredictionJasmine Sekhon, Cody H. FlemingAAAI 2021 · 29 citations
- SGCN: Sparse Graph Convolution Network for Pedestrian Trajectory PredictionLiushuai Shi, Le Wang, Chengjiang Long, Sanping Zhou et al.CVPR 2021
- Three Steps to Multimodal Trajectory Prediction: Modality Clustering, Classification and SynthesisJianhua Sun, Yuxuan Li, Haoshu Fang, Cewu LuICCV 2021 · 91 citations
- MG-GAN: A Multi-Generator Model Preventing Out-of-Distribution Samples in Pedestrian Trajectory PredictionPatrick Dendorfer, Sven Elflein, Laura Leal-TaixéICCV 2021 · 144 citations
- Unlimited Neighborhood Interaction for Heterogeneous Trajectory PredictionFang Zheng, Le Wang, Sanping Zhou, Wei Tang et al.ICCV 2021 · 39 citations
