Multivariate Time-series Imputation with Disentangled Temporal Representations
Shuai Liu, Xiucheng Li, Gao Cong, Yile Chen, Yue Jiang
Abstract
Multivariate time series often faces the problem of missing value. Many time series imputation methods have been developed in literature. However, they all rely on an entangled representation to model dynamics of time series, which may fail to fully exploit the multiple factors (e.g., periodic patterns) presented in the data. Moreover, the entangled representations usually have no semantic meaning, and thus they often lack interpretability. In addition, many recent models are proposed to deal with the whole time series to identify temporal dynamics, but they are not scalable to long time series. Different from existing approaches, we propose TIDER, a novel matrix factorization-based method with disentangled temporal representations that account for multiple factors, namely trend, seasonality, and local bias, to model complex dynamics. The learned disentanglement makes the imputation process more reliable and offers explainability for imputation results. Moreover, TIDER is scalable to long time series. Empirical results show that our method outperforms existing approaches on three typical real-world datasets, especially on long time series, reducing mean absolute error by up to 50%. It also scales well to long datasets on which existing deep learning based methods struggle. Disentanglement validation experiments further highlight the robustness and accuracy of our model. * The main part of Xiucheng's work is done when he is in Nanyang Technological University.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 1e60e96d-0caa-49ae-a0c9-1a0ae5fcffc5Cited by top-tier papers16
- Diffusion-TS: Interpretable Diffusion for General Time Series GenerationXinyu Yuan, Yan QiaoICLR 2024 · 201 citations
- ImputeFormer: Low Rankness-Induced Transformers for Generalizable Spatiotemporal ImputationTong Nie, Guoyang Qin, Wei Ma, Yuewen Mei et al.KDD 2024 · 58 citations
- Frequency-aware Generative Models for Multivariate Time Series ImputationXinyu Yang, Yu Sun, Xiaojie Yuan, Xinyang ChenNeurIPS 2024 · 41 citations
- Biased Temporal Convolution Graph Network for Time Series Forecasting with Missing ValuesXiaodan Chen, Xiucheng Li, Bo Liu, Zhijun LiICLR 2024 · 35 citations
- Vector Quantization Pretraining for EEG Time Series with Random Projection and Phase AlignmentHaokun Gui, Xiucheng Li, Xinyang ChenICML 2024 · 21 citations
Builds on10
- CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series ImputationYusuke Tashiro, Jiaming Song, Yang Song, Stefano ErmonNeurIPS 2021 · 1,245 citations
- CoST: Contrastive Learning of Disentangled Seasonal-Trend Representations for Time Series ForecastingGerald Woo, Chenghao Liu, Doyen Sahoo, Akshat Kumar et al.ICLR 2022 · 468 citations
- Unsupervised Representation Learning for Time Series with Temporal Neighborhood CodingSana Tonekaboni, Danny Eytan, Anna GoldenbergICLR 2021 · 386 citations
- Generative Semi-supervised Learning for Multivariate Time Series ImputationXiaoye Miao, Yangyang Wu, Jun Wang, Yunjun Gao et al.AAAI 2021 · 212 citations
- Filling the G_ap_s: Multivariate Time Series Imputation by Graph Neural NetworksAndrea Cini, Ivan Marisca, Cesare AlippiICLR 2022 · 179 citations
Related papers
- Learning Representations for Incomplete Time Series ClusteringQianli Ma, Chuxin Chen, Sen Li, Garrison W. CottrellAAAI 2021 · 34 citations
- Time-Frequency Conditioned Diffusion for Multivariate Time Series ImputationYumeng Liu, Zheng Wang, Jikui Liu, Kaisa Zhang et al.ICDE 2026
- T-Rep: Representation Learning for Time Series using Time-EmbeddingsArchibald Fraikin, Adrien Bennetot, Stéphanie AllassonnièreICLR 2024 · 24 citations
- TS3Net: Triple Decomposition with Spectrum Gradient for Long-Term Time Series AnalysisXiangkai Ma, Xiaobin Hong, Sanglu Lu, Wenzhong LiICDE 2024 · 3 citations
- A Transformer-based Framework for Multivariate Time Series Representation LearningGeorge Zerveas, Srideepika Jayaraman, Dhaval Patel, Anuradha Bhamidipaty et al.KDD 2021 · 66 citations
