On the Identification of Temporal Causal Representation with Instantaneous Dependence
Zijian Li, Yifan Shen, Kaitao Zheng, Ruichu Cai, Xiangchen Song, Mingming Gong, Guangyi Chen, Kun Zhang
摘要
Temporally causal representation learning aims to identify the latent causal process from time series observations, but most methods require the assumption that the latent causal processes do not have instantaneous relations. Although some recent methods achieve identifiability in the instantaneous causality case, they require either interventions on the latent variables or grouping of the observations, which are in general difficult to obtain in real-world scenarios. To fill this gap, we propose an IDentification framework for instantaneOus Latent dynamics (IDOL) by imposing a sparse influence constraint that the latent causal processes have sparse time-delayed and instantaneous relations. Specifically, we establish identifiability results of the latent causal process based on sufficient variability and the sparse influence constraint by employing contextual information of time series data. Based on these theories, we incorporate a temporally variational inference architecture to estimate the latent variables and a gradient-based sparsity regularization to identify the latent causal process. Experimental results on simulation datasets illustrate that our method can identify the latent causal process. Furthermore, evaluations on multiple human motion forecasting benchmarks with instantaneous dependencies indicate the effectiveness of our method in real-world settings.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper6
- Towards Identifiability of Hierarchical Temporal Causal Representation LearningZijian Li, Minghao Fu, Junxian Huang, Yifan Shen 等NeurIPS 2025 · 被引用 10 次
- LLM Interpretability with Identifiable Temporal-Instantaneous RepresentationXiangchen Song, Jiaqi Sun, Zijian Li, Yujia Zheng 等NeurIPS 2025 · 被引用 6 次
- Online time series prediction using feature adjustmentXiannan Huang, Shuhan Qiu, Jiayuan Du, Chao YangICLR 2026 · 被引用 5 次
- Online Time Series Forecasting with Theoretical GuaranteesZijian Li, Changze Zhou, Minghao Fu, Sanjay Manjunath 等NeurIPS 2025 · 被引用 3 次
- Hierarchical Action Learning for Weakly-Supervised Action SegmentationJunxian Huang, Ruichu Cai, Juntao Fang, Hao Zhu 等CVPR 2026 · 被引用 1 次
它引用的顶会 Paper41
- Informer: Beyond Efficient Transformer for Long Sequence Time-Series ForecastingHaoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang 等AAAI 2021 · 被引用 7,289 次
- Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series ForecastingHaixu Wu, Jiehui Xu, Jianmin Wang, Mingsheng LongNeurIPS 2021 · 被引用 5,824 次
- Efficiently Modeling Long Sequences with Structured State SpacesAlbert Gu, Karan Goel, Christopher RéICLR 2022 · 被引用 3,482 次
- iTransformer: Inverted Transformers Are Effective for Time Series ForecastingYong Liu, Tengge Hu, Haoran Zhang, Haixu Wu 等ICLR 2024 · 被引用 1,703 次
- Combining Recurrent, Convolutional, and Continuous-time Models with Linear State Space LayersAlbert Gu, Isys Johnson, Karan Goel, Khaled Saab 等NeurIPS 2021 · 被引用 1,280 次
相关 Paper
- Learning General Causal Structures with Hidden Dynamic Process for Climate AnalysisMinghao Fu, Biwei Huang, Zijian Li, Yujia Zheng 等ICML 2026
- Causal Temporal Representation Learning with Nonstationary Sparse TransitionXiangchen Song, Zijian Li, Guangyi Chen, Yujia Zheng 等NeurIPS 2024 · 被引用 18 次
- Learning Temporally Causal Latent Processes from General Temporal DataWeiran Yao, Yuewen Sun, Alex Ho, Changyin Sun 等ICLR 2022 · 被引用 108 次
- Causal Representation Learning Made Identifiable by Grouping of Observational VariablesHiroshi Morioka, Aapo HyvärinenICML 2024 · 被引用 26 次
- Causal Representation Learning for Instantaneous and Temporal Effects in Interactive SystemsPhillip Lippe, Sara Magliacane, Sindy Löwe, Yuki M. Asano 等ICLR 2023
