On the Identification of Temporal Causal Representation with Instantaneous Dependence
Zijian Li, Yifan Shen, Kaitao Zheng, Ruichu Cai, Xiangchen Song, Mingming Gong, Guangyi Chen, Kun Zhang
Abstract
Temporally causal representation learning aims to identify the latent causal process from time series observations, but most methods require the assumption that the latent causal processes do not have instantaneous relations. Although some recent methods achieve identifiability in the instantaneous causality case, they require either interventions on the latent variables or grouping of the observations, which are in general difficult to obtain in real-world scenarios. To fill this gap, we propose an IDentification framework for instantaneOus Latent dynamics (IDOL) by imposing a sparse influence constraint that the latent causal processes have sparse time-delayed and instantaneous relations. Specifically, we establish identifiability results of the latent causal process based on sufficient variability and the sparse influence constraint by employing contextual information of time series data. Based on these theories, we incorporate a temporally variational inference architecture to estimate the latent variables and a gradient-based sparsity regularization to identify the latent causal process. Experimental results on simulation datasets illustrate that our method can identify the latent causal process. Furthermore, evaluations on multiple human motion forecasting benchmarks with instantaneous dependencies indicate the effectiveness of our method in real-world settings.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 383bc705-37f6-4347-892a-a5d4fe858ef5Cited by top-tier papers6
- Towards Identifiability of Hierarchical Temporal Causal Representation LearningZijian Li, Minghao Fu, Junxian Huang, Yifan Shen et al.NeurIPS 2025 · 10 citations
- LLM Interpretability with Identifiable Temporal-Instantaneous RepresentationXiangchen Song, Jiaqi Sun, Zijian Li, Yujia Zheng et al.NeurIPS 2025 · 6 citations
- Online time series prediction using feature adjustmentXiannan Huang, Shuhan Qiu, Jiayuan Du, Chao YangICLR 2026 · 5 citations
- Online Time Series Forecasting with Theoretical GuaranteesZijian Li, Changze Zhou, Minghao Fu, Sanjay Manjunath et al.NeurIPS 2025 · 3 citations
- Hierarchical Action Learning for Weakly-Supervised Action SegmentationJunxian Huang, Ruichu Cai, Juntao Fang, Hao Zhu et al.CVPR 2026 · 1 citation
Builds on41
- Informer: Beyond Efficient Transformer for Long Sequence Time-Series ForecastingHaoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang et al.AAAI 2021 · 7,289 citations
- Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series ForecastingHaixu Wu, Jiehui Xu, Jianmin Wang, Mingsheng LongNeurIPS 2021 · 5,824 citations
- Efficiently Modeling Long Sequences with Structured State SpacesAlbert Gu, Karan Goel, Christopher RéICLR 2022 · 3,482 citations
- iTransformer: Inverted Transformers Are Effective for Time Series ForecastingYong Liu, Tengge Hu, Haoran Zhang, Haixu Wu et al.ICLR 2024 · 1,703 citations
- Combining Recurrent, Convolutional, and Continuous-time Models with Linear State Space LayersAlbert Gu, Isys Johnson, Karan Goel, Khaled Saab et al.NeurIPS 2021 · 1,280 citations
Related papers
- Learning General Causal Structures with Hidden Dynamic Process for Climate AnalysisMinghao Fu, Biwei Huang, Zijian Li, Yujia Zheng et al.ICML 2026
- Causal Temporal Representation Learning with Nonstationary Sparse TransitionXiangchen Song, Zijian Li, Guangyi Chen, Yujia Zheng et al.NeurIPS 2024 · 18 citations
- Learning Temporally Causal Latent Processes from General Temporal DataWeiran Yao, Yuewen Sun, Alex Ho, Changyin Sun et al.ICLR 2022 · 108 citations
- Causal Representation Learning Made Identifiable by Grouping of Observational VariablesHiroshi Morioka, Aapo HyvärinenICML 2024 · 26 citations
- Causal Representation Learning for Instantaneous and Temporal Effects in Interactive SystemsPhillip Lippe, Sara Magliacane, Sindy Löwe, Yuki M. Asano et al.ICLR 2023
