Physics-Informed Inference Time Scaling for Solving High-Dimensional Partial Differential Equations
Zexi Fan, Yan Sun, Shihao Yang, Yiping Lu
Abstract
Solving high-dimensional partial differential equations (PDEs) is a critical challenge where modern data-driven solvers often lack reliability and rigorous error guarantees. We introduce Simulation-Calibrated Scientific Machine Learning (SCaSML), a framework that systematically improves pre-trained PDE solvers at inference time without any retraining. Our core idea is to derive a new PDE, which we term the Law of Defect, that precisely governs the error of a given surrogate model. Because this defect PDE retains the structure of the original problem, we can solve it efficiently with traditional stochastic simulators, yielding a targeted correction to the initial machine-learned solution. We prove that SCaSML achieves a faster convergence rate, with a final error bounded by the product of the surrogate and simulation errors. On challenging PDEs up to 160 dimensions, SCaSML reduces the error of various surrogate models, including PINNs and Gaussian Processes, by 20-80%. SCaSML provides a principled method to fuse the speed of machine learning with the rigor of numerical simulation, enhancing the trustworthiness of Al for scientific discovery.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 9759770c-5132-40a9-ad74-3be2f9060e76Cited by top-tier papers1
Ask how each one uses itBuilds on6
- Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
- Solving high-dimensional parabolic PDEs using the tensor train formatLorenz Richter, Leon Sallandt, Nikolas NüskenICML 2021 · 62 citations
- Machine Learning For Elliptic PDEs: Fast Rate Generalization Bound, Neural Scaling Law and Minimax OptimalityYiping Lu, Haoxuan Chen, Jianfeng Lu, Lexing Ying et al.ICLR 2022 · 54 citations
- Stochastic Taylor Derivative Estimator: Efficient amortization for arbitrary differential operatorsZekun Shi, Zheyuan Hu, Min Lin, Kenji KawaguchiNeurIPS 2024 · 32 citations
- Sobolev Acceleration and Statistical Optimality for Learning Elliptic Equations via Gradient DescentYiping Lu, José H. Blanchet, Lexing YingNeurIPS 2022 · 15 citations
Related papers
- Learning Neural PDE Solvers with Parameter-Guided Channel AttentionMakoto Takamoto, Francesco Alesiani, Mathias NiepertICML 2023 · 41 citations
- Solver-in-the-Loop: Learning from Differentiable Physics to Interact with Iterative PDE-SolversKiwon Um, Robert Brand, Yun (Raymond) Fei, Philipp Holl et al.NeurIPS 2020 · 398 citations
- Disentangled Multi-Fidelity Deep Bayesian Active LearningDongxia Wu, Ruijia Niu, Matteo Chinazzi, Yi-An Ma et al.ICML 2023 · 15 citations
- Learning Physical Models that Can Respect Conservation LawsDerek Hansen, Danielle C. Maddix, Shima Alizadeh, Gaurav Gupta et al.ICML 2023 · 73 citations
- Using Uncertainty Quantification to Characterize and Improve Out-of-Domain Learning for PDEsS. Chandra Mouli, Danielle C. Maddix, Shima Alizadeh, Gaurav Gupta et al.ICML 2024 · 9 citations
