Learning Data-Efficient and Generalizable Neural Operators via Fundamental Physics Knowledge
Siying (Sydney) Ma, Mehrdad Momeni Zadeh, Mauricio Soroco, Wuyang Chen, Jiguo Cao, Vijay Ganesh
Abstract
Recent advances in scientific machine learning (SciML) have enabled neural operators (NOs) to serve as powerful surrogates for modeling the dynamic evolution of physical systems governed by partial differential equations (PDEs). While existing approaches focus primarily on learning simulations from the target PDE, they often overlook more fundamental physical principles underlying these equations. Inspired by how numerical solvers are compatible with simulations of different settings of PDEs, we propose a multiphysics training framework that jointly learns from both the original PDEs and their simplified basic forms. Our framework enhances data efficiency, reduces predictive errors, and improves out-of-distribution (OOD) generalization, particularly in scenarios involving shifts of physical parameters and synthetic-to-real transfer. Our method is architecture-agnostic and demonstrates consistent improvements in normalized root mean square error (nRMSE) across a wide range of 1D/2D/3D PDE problems. Through extensive experiments, we show that explicit incorporation of fundamental physics knowledge significantly strengthens the generalization ability of neural operators. We will release models and codes at https://sites.google.com/view/sciml-fundemental-pde .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e0a62e6e-522f-4ef2-9ab0-ad4a4844b1f5Cited by top-tier papers1
Ask how each one uses itBuilds on15
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- Fourier Neural Operator for Parametric Partial Differential EquationsZongyi Li, Nikola Borislavov Kovachki, Kamyar Azizzadenesheli, Burigede Liu et al.ICLR 2021 · 3,911 citations
- VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-TrainingZhan Tong, Yibing Song, Jue Wang, Limin WangNeurIPS 2022 · 2,336 citations
- Characterizing possible failure modes in physics-informed neural networksAditi S. Krishnapriyan, Amir Gholami, Shandian Zhe, Robert M. Kirby et al.NeurIPS 2021 · 1,421 citations
- Multipole Graph Neural Operator for Parametric Partial Differential EquationsZongyi Li, Nikola B. Kovachki, Kamyar Azizzadenesheli, Burigede Liu et al.NeurIPS 2020 · 569 citations
Related papers
- Towards Foundation Models for Scientific Machine Learning: Characterizing Scaling and Transfer BehaviorShashank Subramanian, Peter Harrington, Kurt Keutzer, Wahid Bhimji et al.NeurIPS 2023 · 173 citations
- Learning Neural PDE Solvers with Parameter-Guided Channel AttentionMakoto Takamoto, Francesco Alesiani, Mathias NiepertICML 2023 · 41 citations
- DeltaPhi: Physical States Residual Learning for Neural Operators in Data-Limited PDE SolvingXihang Yue, Yi Yang, Linchao ZhuNeurIPS 2025 · 5 citations
- Origo: Interpretable Multi-physics PDE Foundation Model through Neural Operator SplittingLi Sun, Hongbo Lv, Zhikai Jiang, Zhongtian Sun et al.ICML 2026
- From Cheap Geometry to Expensive Physics: A Physics-agnostic Pretraining Framework for Neural OperatorsZhizhou Zhang, Youjia Wu, Kaixuan Zhang, Yanjia WangICLR 2026 · 1 citation
