Predicting partially observable dynamical systems via diffusion models with a multiscale inference scheme
Rudy Morel, Francesco Pio Ramunno, Jeff Shen, Alberto Bietti, Kyunghyun Cho, Miles D. Cranmer, Siavash Golkar, Olexandr Gugnin, Géraud Krawezik, Tanya Marwah, Michael McCabe, Lucas Meyer
Abstract
Conditional diffusion models provide a natural framework for probabilistic prediction of dynamical systems and have been successfully applied to fluid dynamics and weather prediction. However, in many settings, the available information at a given time represents only a small fraction of what is needed to predict future states, either due to measurement uncertainty or because only a small fraction of the state can be observed. This is true for example in solar physics, where we can observe the Sun's surface and atmosphere, but its evolution is driven by internal processes for which we lack direct measurements. In this paper, we tackle the probabilistic prediction of partially observable, long-memory dynamical systems, with applications to solar dynamics and the evolution of active regions. We show that standard inference schemes, such as autoregressive rollouts, fail to capture long-range dependencies in the data, largely because they do not integrate past information effectively. To overcome this, we propose a multiscale inference scheme for diffusion models, tailored to physical processes. Our method generates trajectories that are temporally fine-grained near the present and coarser as we move farther away, which enables capturing long-range temporal dependencies without increasing computational cost. When integrated into a diffusion model, we show that our inference scheme significantly reduces the bias of the predicted distributions and improves rollout stability.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers3
- Strictly Constrained Generative Modeling via Split Augmented Langevin SamplingMatthieu Blanke, Yongquan Qu, Sara Shamekh, Pierre GentineICLR 2026 · 7 citations
- SENDAI: A Hierarchical Sparse-measurement, EfficieNt Data AssImilation FrameworkXingyue Zhang, Yuxuan Bao, Mars Liyao Gao, J. Nathan KutzICML 2026
- Smoothness Errors in Dynamics Models and How to Avoid ThemEdward Berman, Luisa Li, Jung Yeon Park, Robin WaltersICML 2026
Builds on23
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- Directly Denoising Diffusion ModelsDan Zhang, Jingjing Wang, Feng LuoICML 2024 · 11,724 citations
- Elucidating the Design Space of Diffusion-Based Generative ModelsTero Karras, Miika Aittala, Timo Aila, Samuli LaineNeurIPS 2022 · 3,959 citations
- Video Diffusion ModelsJonathan Ho, Tim Salimans, Alexey A. Gritsenko, William Chan et al.NeurIPS 2022 · 2,948 citations
Related papers
- Thermalizer: Stable autoregressive neural emulation of spatiotemporal chaosChristian Pedersen, Laure Zanna, Joan BrunaICML 2025
- Elucidated Rolling Diffusion Models for Probabilistic Forecasting of Complex DynamicsSalva Rühling Cachay, Miika Aittala, Karsten Kreis, Noah D. Brenowitz et al.NeurIPS 2025 · 15 citations
- DYffusion: A Dynamics-informed Diffusion Model for Spatiotemporal ForecastingSalva Rühling Cachay, Bo Zhao, Hailey Joren, Rose YuNeurIPS 2023 · 164 citations
- Incomplete Data, Complete Dynamics: A Diffusion ApproachZihan Zhou, Chenguang Wang, Hongyi Ye, Yongtao Guan et al.ICLR 2026 · 3 citations
- PDE-Refiner: Achieving Accurate Long Rollouts with Neural PDE SolversPhillip Lippe, Bas Veeling, Paris Perdikaris, Richard E. Turner et al.NeurIPS 2023 · 280 citations
