Causal Intervention for Human Trajectory Prediction with Cross Attention Mechanism
Chunjiang Ge, Shiji Song, Gao Huang
Abstract
Human trajectory Prediction (HTP) in complex social environments plays a crucial and fundamental role in artificial intelligence systems. Conventional methods make use of both history behaviors and social interactions to forecast future trajectories. However, we demonstrate that the social environment is a confounder that misleads the model to learn spurious correlations between history and future trajectories. To end this, we first formulate the social environment, history and future trajectory variables into a structural causal model to analyze the causalities among them. Based on causal intervention rather than conventional likelihood, we propose a Social Environment ADjustment (SEAD) method, to remove the confounding effect of the social environment. The core of our method is implemented by a Social Cross Attention (SCA) module, which is universal, simple and effective. Our method has consistent improvements on ETH-UCY datasets with three baseline models and achieves competitive performances with existing methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a5f072f2-e7a8-4b14-ab04-0e199b3fc80bCited by top-tier papers5
- Improving Transferability for Cross-Domain Trajectory Prediction via Neural Stochastic Differential EquationDaehee Park, Jaewoo Jeong, Kuk-Jin YoonAAAI 2024 · 17 citations
- CaDeT: A Causal Disentanglement Approach for Robust Trajectory Prediction in Autonomous DrivingMozhgan Pourkeshavarz, Junrui Zhang, Amir RasouliCVPR 2024 · 15 citations
- Resonance: Learning to Predict Social-Aware Pedestrian Trajectories as Co-VibrationsConghao Wong, Ziqian Zou, Beihao XiaICCV 2025 · 1 citation
- Causal Composition Diffusion Model for Closed-loop Traffic GenerationHaohong Lin, Xin Huang, Tung Phan, David S. Hayden et al.CVPR 2025
- Reward-Preserving Counterfactual State Editing for Offline Reinforcement LearningSiyu Wang, Xiaocong Chen, Mingming Gong, Yong Li et al.ICML 2026
Builds on12
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Align before Fuse: Vision and Language Representation Learning with Momentum DistillationJunnan Li, Ramprasaath R. Selvaraju, Akhilesh Gotmare, Shafiq R. Joty et al.NeurIPS 2021 · 2,985 citations
- STGAT: Modeling Spatial-Temporal Interactions for Human Trajectory PredictionYingfan Huang, Huikun Bi, Zhaoxin Li, Tianlu Mao et al.ICCV 2019 · 615 citations
- Causal Intervention for Weakly-Supervised Semantic SegmentationDong Zhang, Hanwang Zhang, Jinhui Tang, Xian-Sheng Hua et al.NeurIPS 2020 · 563 citations
- Long-Tailed Classification by Keeping the Good and Removing the Bad Momentum Causal EffectKaihua Tang, Jianqiang Huang, Hanwang ZhangNeurIPS 2020 · 533 citations
Related papers
- Human Trajectory Prediction via Counterfactual AnalysisGuangyi Chen, Junlong Li, Jiwen Lu, Jie ZhouICCV 2021 · 90 citations
- Recursive Social Behavior Graph for Trajectory PredictionJianhua Sun, Qinhong Jiang, Cewu LuCVPR 2020
- Trajectory Prediction in Heterogeneous Environment via Attended Ecology EmbeddingWei-Cheng Lai, Zi-Xiang Xia, Hao-Siang Lin, Lien-Feng Hsu et al.ACM MM 2020 · 27 citations
- Introvert: Human Trajectory Prediction via Conditional 3D AttentionNasim Shafiee, Taskin Padir, Ehsan ElhamifarCVPR 2021
- Cross Time Domain Intention Interaction for Conditional Trajectory PredictionYuxiang Zhao, Wei Huang, Haipeng Zeng, Huan Zhao et al.ACM MM 2025
