CausalX: A Unified and Causally-Interpretable Plug-and-Play Model for Multi-modal Spatio-Temporal Forecasting
Shiqi Zhang, Pan Mu, HantingYan, Yuchao Zhu, jinglin zhang, Cong Bai
Abstract
Multi-modal spatio-temporal forecasting underpins many real-world applications but remains challenging due to the complex and evolving interactions across modalities and time steps. Moreover, the lack of interpretability in existing models limits their reliability in safety-critical scenarios. In this paper, we present CausalX, a unified and causally interpretable plug-and-play model for multi-modal spatio-temporal forecasting. CausalX achieves interpretability by learning a dynamic causal-inspired graph across modalities and time, whose edge weights quantify causal attribution strength, and are further refined by a diffusion-based generative process guided by structural priors. To overcome the absence of ground-truth causal structures, CausalX aggregates multi-source constraints from causal analysis techniques and a variational autoencoder, spanning predictive, temporal, interventional, and generative aspects to jointly learn a more comprehensive causal-inspired graph. Extensive experiments on real-world forecasting tasks, including pedestrian trajectory prediction and tropical cyclone forecasting, demonstrate that CausalX achieves superior accuracy while producing interpretable causal-inspired graphs. CausalX is modular, architecture-agnostic, and generalizable, offering a new perspective on bridging causal inference and spatio-temporal forecasting.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext fc891c77-a9a1-436a-ac11-dece87f2801bBuilds on9
- AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent ForecastingYe Yuan, Xinshuo Weng, Yanglan Ou, Kris KitaniICCV 2021 · 658 citations
- Stochastic Trajectory Prediction via Motion Indeterminacy DiffusionTianpei Gu, Guangyi Chen, Junlong Li, Chunze Lin et al.CVPR 2022 · 261 citations
- Deciphering Spatio-Temporal Graph Forecasting: A Causal Lens and TreatmentYutong Xia, Yuxuan Liang, Haomin Wen, Xu Liu et al.NeurIPS 2023 · 110 citations
- Three Steps to Multimodal Trajectory Prediction: Modality Clustering, Classification and SynthesisJianhua Sun, Yuxuan Li, Haoshu Fang, Cewu LuICCV 2021 · 91 citations
- Human Trajectory Prediction via Counterfactual AnalysisGuangyi Chen, Junlong Li, Jiwen Lu, Jie ZhouICCV 2021 · 90 citations
Related papers
- Augur: Modeling Covariate Causal Associations in Time Series via Large Language ModelsZhiqing Cui, Binwu Wang, Qingxiang Liu, Yeqiang Wang et al.ACL 2026
- CausalPOI: Spatio-Temporal Graph-Based Causal Modeling for Cold-Start POI Check-in ForecastingZhaoqi Zhang, Miao Xie, Yi Li, Linyou Cai et al.KDD 2026 · 1 citation
- A Causality Inspired Framework for Model InterpretationChenwang Wu, Xiting Wang, Defu Lian, Xing Xie et al.KDD 2023 · 22 citations
- Causality-Inspired Spatial-Temporal Explanations for Dynamic Graph Neural NetworksKesen Zhao, Liang ZhangICLR 2024 · 7 citations
- GRIN: Generative Relation and Intention Network for Multi-agent Trajectory PredictionLongyuan Li, Jian Yao, Li K. Wenliang, Tong He et al.NeurIPS 2021 · 51 citations
