Multivariate Probabilistic Time Series Forecasting via Conditioned Normalizing Flows
Kashif Rasul, Abdul-Saboor Sheikh, Ingmar Schuster, Urs M. Bergmann, Roland Vollgraf
Abstract
Time series forecasting is often fundamental to scientific and engineering problems and enables decision making. With ever increasing data set sizes, a trivial solution to scale up predictions is to assume independence between interacting time series. However, modeling statistical dependencies can improve accuracy and enable analysis of interaction effects. Deep learning methods are well suited for this problem, but multivariate models often assume a simple parametric distribution and do not scale to high dimensions. In this work we model the multivariate temporal dynamics of time series via an autoregressive deep learning model, where the data distribution is represented by a conditioned normalizing flow. This combination retains the power of autoregressive models, such as good performance in extrapolation into the future, with the flexibility of flows as a general purpose high-dimensional distribution model, while remaining computationally tractable. We show that it improves over the state-of-the-art for standard metrics on many real-world data sets with several thousand interacting time-series.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 742ca59d-7e10-42d3-87cb-9ab68f299747Cited by top-tier papers55
- CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series ImputationYusuke Tashiro, Jiaming Song, Yang Song, Stefano ErmonNeurIPS 2021 · 1,245 citations
- Diffusion Forcing: Next-token Prediction Meets Full-Sequence DiffusionBoyuan Chen, Diego Marti Monso, Yilun Du, Max Simchowitz et al.NeurIPS 2024 · 751 citations
- Autoregressive Denoising Diffusion Models for Multivariate Probabilistic Time Series ForecastingKashif Rasul, Calvin Seward, Ingmar Schuster, Roland VollgrafICML 2021 · 500 citations
- Probabilistic Transformer For Time Series AnalysisBinh Tang, David S. MattesonNeurIPS 2021 · 150 citations
- Predict, Refine, Synthesize: Self-Guiding Diffusion Models for Probabilistic Time Series ForecastingMarcel Kollovieh, Abdul Fatir Ansari, Michael Bohlke-Schneider, Jasper Zschiegner et al.NeurIPS 2023 · 145 citations
Builds on3
- N-BEATS: Neural basis expansion analysis for interpretable time series forecastingBoris N. Oreshkin, Dmitri Carpov, Nicolas Chapados, Yoshua BengioICLR 2020 · 1,550 citations
- Normalizing Kalman Filters for Multivariate Time Series AnalysisEmmanuel de Bézenac, Syama Sundar Rangapuram, Konstantinos Benidis, Michael Bohlke-Schneider et al.NeurIPS 2020 · 134 citations
- Conditional Recurrent Flow: Conditional Generation of Longitudinal Samples With Applications to NeuroimagingSeong Jae Hwang, Zirui Tao, Vikas Singh, Won Hwa KimICCV 2019 · 13 citations
Related papers
- Temporal Latent Auto-Encoder: A Method for Probabilistic Multivariate Time Series ForecastingNam Nguyen, Brian QuanzAAAI 2021 · 87 citations
- Autoregressive Quantile Flows for Predictive Uncertainty EstimationPhillip Si, Allan Bishop, Volodymyr KuleshovICLR 2022 · 22 citations
- Graph Neural Flows for Unveiling Systemic Interactions Among Irregularly Sampled Time SeriesGiangiacomo Mercatali, André Freitas, Jie ChenNeurIPS 2024 · 17 citations
- Probabilistic Forecasting of Irregularly Sampled Time Series with Missing Values via Conditional Normalizing FlowsVijaya Krishna Yalavarthi, Randolf Scholz, Stefan Born, Lars Schmidt-ThiemeAAAI 2025 · 6 citations
- Graph-Augmented Normalizing Flows for Anomaly Detection of Multiple Time SeriesEnyan Dai, Jie ChenICLR 2022 · 111 citations
