Spectral-Inspired Neural Operator Learning with Limited Data and Unknown Physics
Han Wan, Rui Zhang, Hao Sun
Abstract
Learning PDE dynamics from limited data with unknown physics is challenging. Existing neural PDE solvers either require large datasets or rely on known physics (e.g., PDE residuals or handcrafted stencils), leading to limited applicability. To address these challenges, we propose Spectral-Inspired Neural Operator (SINO), which can model complex systems from just 5 trajectories without requiring explicit PDE terms. Specifically, SINO automatically learns Fourier multipliers as functions of frequency indices, capturing both high-order derivatives and global/local couplings, thus enabling a compact representation of the underlying differential operators in physics-agnostic regimes. To model nonlinear effects, it employs a ¶i-block that performs multiplicative interactions on derivative features, followed by a spectral low-pass filter for de-aliasing. Extensive experiments on both 2D and 3D PDE benchmarks demonstrate that SINO achieves state-of-the-art performance, with improvements of 1-2 orders of magnitude in accuracy. Particularly, with only 5 training trajectories, SINO outperforms data-driven methods trained on 200 trajectories and remains predictive on challenging out-of-distribution cases where other methods fail.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7216b865-3076-4064-a655-01f017494a54Builds on22
- A ConvNet for the 2020sZhuang Liu, Hanzi Mao, Chao-Yuan Wu, Christoph Feichtenhofer et al.CVPR 2022 · 6,782 citations
- Fourier Neural Operator for Parametric Partial Differential EquationsZongyi Li, Nikola Borislavov Kovachki, Kamyar Azizzadenesheli, Burigede Liu et al.ICLR 2021 · 3,911 citations
- Characterizing possible failure modes in physics-informed neural networksAditi S. Krishnapriyan, Amir Gholami, Shandian Zhe, Robert M. Kirby et al.NeurIPS 2021 · 1,421 citations
- Learning Mesh-Based Simulation with Graph NetworksTobias Pfaff, Meire Fortunato, Alvaro Sanchez-Gonzalez, Peter W. BattagliaICLR 2021 · 1,175 citations
- Message Passing Neural PDE SolversJohannes Brandstetter, Daniel E. Worrall, Max WellingICLR 2022 · 410 citations
Related papers
- Riesz Neural Operator for Solving Partial Differential Equationsshouyiliu, Xiaokang Yang, Yuntian ChenICLR 2026 · 1 citation
- DeltaPhi: Physical States Residual Learning for Neural Operators in Data-Limited PDE SolvingXihang Yue, Yi Yang, Linchao ZhuNeurIPS 2025 · 5 citations
- SVD-NO: Learning PDE Solution Operators with SVD Integral KernelsNoam Koren, Ralf J. J. Mackenbach, Ruud J. G. van Sloun, Kira Radinsky et al.AAAI 2026
- Neural Stochastic PDEs: Resolution-Invariant Learning of Continuous Spatiotemporal DynamicsCristopher Salvi, Maud Lemercier, Andris GerasimovicsNeurIPS 2022 · 70 citations
- On the Benefits of Memory for Modeling Time-Dependent PDEsRicardo Buitrago Ruiz, Tanya Marwah, Albert Gu, Andrej RisteskiICLR 2025
