Physics-Informed Diffusion Models in Spectral Space
Davide Gallon, Philippe von Wurstemberger, Patrick Cheridito, Arnulf Jentzen
Abstract
We propose physics-informed spectral diffusion (PISD), a methodology that combines generative latent diffusion models with physics-informed machine learning to generate solutions of partial differential equations (PDEs) conditioned on partial observations, which includes, in particular, forward and inverse PDE problems. We learn the joint distribution of PDE parameters and solutions via a diffusion process in a latent space of scaled spectral representations, where Gaussian noise corresponds to functions with controlled regularity. This spectral formulation enables significant dimensionality reduction compared to grid-based diffusion models and ensures that the induced process in function space remains within a class of functions for which the PDE operators are well defined. Building on diffusion posterior sampling, we enforce physics-informed constraints and measurement conditions during inference, applying Adam-based updates at each diffusion step. We evaluate the proposed approach on Poisson, Helmholtz, and incompressible Navier-Stokes equations, demonstrating improved accuracy and computational efficiency compared with existing diffusion-based PDE solvers, which are state of the art for sparse observations. Code is available at https://github.com/deeplearningmethods/PISD .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 91bb5a29-30e6-4692-83b4-767a41f514beCited by top-tier papers1
Ask how each one uses itBuilds on18
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Elucidating the Design Space of Diffusion-Based Generative ModelsTero Karras, Miika Aittala, Timo Aila, Samuli LaineNeurIPS 2022 · 3,959 citations
- Fourier Neural Operator for Parametric Partial Differential EquationsZongyi Li, Nikola Borislavov Kovachki, Kamyar Azizzadenesheli, Burigede Liu et al.ICLR 2021 · 3,911 citations
Related papers
- DiffusionPDE: Generative PDE-Solving under Partial ObservationJiahe Huang, Guandao Yang, Zichen Wang, Jeong Joon ParkNeurIPS 2024 · 148 citations
- Physics-Informed Distillation of Diffusion Models for PDE-Constrained GenerationYi Zhang, Peng Wang, Difan ZouICML 2026 · 9 citations
- Neural Spectral Methods: Self-supervised learning in the spectral domainYiheng Du, Nithin Chalapathi, Aditi S. KrishnapriyanICLR 2024 · 16 citations
- Physics-Constrained Fine-Tuning of Flow-Matching Models for Generation and Inverse ProblemsJan Tauberschmidt, Sophie Fellenz, Sebastian Josef Vollmer, Andrew B. DuncanICLR 2026 · 11 citations
- Text2PDE: Latent Diffusion Models for Accessible Physics SimulationAnthony Y. Zhou, Zijie Li, Michael Schneier, John R. Buchanan Jr. et al.ICLR 2025
