Normalizing Kalman Filters for Multivariate Time Series Analysis
Emmanuel de Bézenac, Syama Sundar Rangapuram, Konstantinos Benidis, Michael Bohlke-Schneider, Richard Kurle, Lorenzo Stella, Hilaf Hasson, Patrick Gallinari, Tim Januschowski
Abstract
This paper tackles the modelling of large, complex and multivariate time series panels in a probabilistic setting. To this extent, we present a novel approach reconciling classical state space models with deep learning methods. By augmenting state space models with normalizing flows, we mitigate imprecisions stemming from idealized assumptions in state space models. The resulting model is highly flexible while still retaining many of the attractive properties of state space models, e.g., uncertainty and observation errors are properly accounted for, inference is tractable, sampling is efficient and good generalization performance is observed, even in low data regimes. We demonstrate competitiveness against state-of-the-art deep learning methods on the tasks of forecasting real world data and handling varying levels of missing data. * Equal contribution. † Work done while at Amazon. 34th Conference on Neural Information Processing Systems (NeurIPS 2020), Vancouver, Canada.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 5a454f2f-695c-4195-9f0a-3d8b7ba9f9e8Cited by top-tier papers39
- Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series ForecastingHaixu Wu, Jiehui Xu, Jianmin Wang, Mingsheng LongNeurIPS 2021 · 5,824 citations
- Diffusion Forcing: Next-token Prediction Meets Full-Sequence DiffusionBoyuan Chen, Diego Marti Monso, Yilun Du, Max Simchowitz et al.NeurIPS 2024 · 751 citations
- Autoregressive Denoising Diffusion Models for Multivariate Probabilistic Time Series ForecastingKashif Rasul, Calvin Seward, Ingmar Schuster, Roland VollgrafICML 2021 · 500 citations
- Generative Time Series Forecasting with Diffusion, Denoise, and DisentanglementYan Li, Xinjiang Lu, Yaqing Wang, Dejing DouNeurIPS 2022 · 203 citations
- DYffusion: A Dynamics-informed Diffusion Model for Spatiotemporal ForecastingSalva Rühling Cachay, Bo Zhao, Hailey Joren, Rose YuNeurIPS 2023 · 164 citations
Builds on2
- N-BEATS: Neural basis expansion analysis for interpretable time series forecastingBoris N. Oreshkin, Dmitri Carpov, Nicolas Chapados, Yoshua BengioICLR 2020 · 1,550 citations
- Multivariate Probabilistic Time Series Forecasting via Conditioned Normalizing FlowsKashif Rasul, Abdul-Saboor Sheikh, Ingmar Schuster, Urs M. Bergmann et al.ICLR 2021
Related papers
- RNN with Particle Flow for Probabilistic Spatio-temporal ForecastingSoumyasundar Pal, Liheng Ma, Yingxue Zhang, Mark CoatesICML 2021 · 26 citations
- Probabilistic Transformer For Time Series AnalysisBinh Tang, David S. MattesonNeurIPS 2021 · 150 citations
- Temporal Latent Auto-Encoder: A Method for Probabilistic Multivariate Time Series ForecastingNam Nguyen, Brian QuanzAAAI 2021 · 87 citations
- Factorized Inference in Deep Markov Models for Incomplete Multimodal Time SeriesZhi-Xuan Tan, Harold Soh, Desmond C. OngAAAI 2020 · 32 citations
- Effectively Modeling Time Series with Simple Discrete State SpacesMichael Zhang, Khaled Kamal Saab, Michael Poli, Tri Dao et al.ICLR 2023 · 14 citations
