COGS: A Causal Representation Learning Framework for Out-of-Distribution Generalization in Time Series
Xinxin Song, Yuxiao Cheng, Tingxiong Xiao, Jinli Suo
Abstract
Time series analysis is crucial in various fields such as healthcare and finance. However, environmental variations and the inherent non-stationarity of time series data often lead to outof-distribution (OOD) scenarios, consequently causing model performance degradation. Most existing OOD generalization methods primarily focus on images or text, leaving time series analysis relatively underexplored. In this paper, we propose COGS, a novel framework that incorporates causal representation learning into the OOD generalization of time series. By imposing structural priors, our method identifies latent variables and learns a causal graph to disentangle causal variables from non-causal ones. These causal variables are then used to learn domain-invariant representations for stable prediction. Moreover, to tackle the challenge of the absence of domain labels, we further introduce a prototype-based domain discovery algorithm that infers domain labels in an unsupervised manner. The entire framework is optimized in a two-phase iterative manner, resulting in robust OOD performance. Extensive experiments on multiple real-world time series datasets demonstrate that our method achieves competitive performance compared to baseline methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext bcd66818-827f-4a41-a6a7-3aa00aa379a6Builds on13
- Distributionally Robust Neural NetworksShiori Sagawa, Pang Wei Koh, Tatsunori B. Hashimoto, Percy LiangICLR 2020 · 1,578 citations
- In Search of Lost Domain GeneralizationIshaan Gulrajani, David Lopez-PazICLR 2021 · 1,416 citations
- Out-of-Distribution Generalization via Risk Extrapolation (REx)David Krueger, Ethan Caballero, Jörn-Henrik Jacobsen, Amy Zhang et al.ICML 2021 · 1,163 citations
- Environment Inference for Invariant LearningElliot Creager, Jörn-Henrik Jacobsen, Richard S. ZemelICML 2021 · 454 citations
- Invariance Principle Meets Information Bottleneck for Out-of-Distribution GeneralizationKartik Ahuja, Ethan Caballero, Dinghuai Zhang, Jean-Christophe Gagnon-Audet et al.NeurIPS 2021 · 372 citations
Related papers
- CauDiTS: Causal Disentangled Domain Adaptation of Multivariate Time SeriesJunxin Lu, Shiliang SunICML 2024 · 2 citations
- Orthogonality Matters: Invariant Time Series Representation for Out-of-distribution ClassificationRuize Shi, Hong Huang, Kehan Yin, Wei Zhou et al.KDD 2024 · 5 citations
- Learning Causal Semantic Representation for Out-of-Distribution PredictionChang Liu, Xinwei Sun, Jindong Wang, Haoyue Tang et al.NeurIPS 2021 · 136 citations
- Learning Causally Invariant Representations for Out-of-Distribution Generalization on GraphsYongqiang Chen, Yonggang Zhang, Yatao Bian, Han Yang et al.NeurIPS 2022 · 246 citations
- Enhancing Evolving Domain Generalization through Dynamic Latent RepresentationsBinghui Xie, Yongqiang Chen, Jiaqi Wang, Kaiwen Zhou et al.AAAI 2024 · 9 citations
