Variational Data Assimilation with a Learned Inverse Observation Operator
Thomas Frerix, Dmitrii Kochkov, Jamie A. Smith, Daniel Cremers, Michael P. Brenner, Stephan Hoyer
Abstract
Variational data assimilation optimizes for an initial state of a dynamical system such that its evolution fits observational data. The physical model can subsequently be evolved into the future to make predictions. This principle is a cornerstone of large scale forecasting applications such as numerical weather prediction. As such, it is implemented in current operational systems of weather forecasting agencies across the globe. However, finding a good initial state poses a difficult optimization problem in part due to the non-invertible relationship between physical states and their corresponding observations. We learn a mapping from observational data to physical states and show how it can be used to improve optimizability. We employ this mapping in two ways: to better initialize the non-convex optimization problem, and to reformulate the objective function in better behaved physics space instead of observation space. Our experimental results for the Lorenz96 model and a two-dimensional turbulent fluid flow demonstrate that this procedure significantly improves forecast quality for chaotic systems.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 2b26109d-31e8-46ce-8c2f-5b3cdc175a52Cited by top-tier papers9
- Efficient and Modular Implicit DifferentiationMathieu Blondel, Quentin Berthet, Marco Cuturi, Roy Frostig et al.NeurIPS 2022 · 386 citations
- Score-based Data AssimilationFrançois Rozet, Gilles LouppeNeurIPS 2023 · 134 citations
- Physics-Integrated Variational Autoencoders for Robust and Interpretable Generative ModelingNaoya Takeishi, Alexandros KalousisNeurIPS 2021 · 88 citations
- Learning to Solve PDE-constrained Inverse Problems with Graph NetworksQingqing Zhao, David B. Lindell, Gordon WetzsteinICML 2022 · 52 citations
- Bayesian Spline Learning for Equation Discovery of Nonlinear Dynamics with Quantified UncertaintyLuning Sun, Daniel Huang, Hao Sun, Jian-Xun WangNeurIPS 2022 · 23 citations
Builds on3
- Solver-in-the-Loop: Learning from Differentiable Physics to Interact with Iterative PDE-SolversKiwon Um, Robert Brand, Yun (Raymond) Fei, Philipp Holl et al.NeurIPS 2020 · 398 citations
- MeshfreeFlowNet: a physics-constrained deep continuous space-time super-resolution frameworkChiyu Max Jiang, Soheil Esmaeilzadeh, Kamyar Azizzadenesheli, Karthik Kashinath et al.SC 2020 · 107 citations
- Learning Composable Energy Surrogates for PDE Order ReductionAlex Beatson, Jordan T. Ash, Geoffrey Roeder, Tianju Xue et al.NeurIPS 2020 · 17 citations
Related papers
- Latent-EnSF: A Latent Ensemble Score Filter for High-Dimensional Data Assimilation with Sparse Observation DataPhillip Si, Peng ChenICLR 2025
- Learning to Assimilate in Chaotic Dynamical SystemsMichael McCabe, Jed BrownNeurIPS 2021 · 19 citations
- VAE-Var: Variational Autoencoder-Enhanced Variational Methods for Data Assimilation in MeteorologyYi Xiao, Qilong Jia, Kun Chen, Lei Bai et al.ICLR 2025
- DAWP: A framework for global observation forecasting via Data Assimilation and Weather Prediction in satellite observation spaceJunchao Gong, Jingyi Xu, Ben Fei, Fenghua Ling et al.NeurIPS 2025 · 2 citations
- FlowDAS: A Stochastic Interpolant-based Framework for Data AssimilationSiyi Chen, Yixuan Jia, Qing Qu, He Sun et al.NeurIPS 2025 · 19 citations
