Multiwavelet-based Operator Learning for Differential Equations
Gaurav Gupta, Xiongye Xiao, Paul Bogdan
Abstract
The solution of a partial differential equation can be obtained by computing the inverse operator map between the input and the solution space. Towards this end, we introduce a multiwavelet-based neural operator learning scheme that compresses the associated operator's kernel using fine-grained wavelets. By explicitly embedding the inverse multiwavelet filters, we learn the projection of the kernel onto fixed multiwavelet polynomial bases. The projected kernel is trained at multiple scales derived from using repeated computation of multiwavelet transform. This allows learning the complex dependencies at various scales and results in a resolution-independent scheme. Compare to the prior works, we exploit the fundamental properties of the operator's kernel which enable numerically efficient representation. We perform experiments on the Korteweg-de Vries (KdV) equation, Burgers' equation, Darcy Flow, and Navier-Stokes equation. Compared with the existing neural operator approaches, our model shows significantly higher accuracy and achieves state-of-the-art in a range of datasets. For the time-varying equations, the proposed method exhibits a () improvement ( () relative error for Burgers' (KdV) equation). By learning the mappings between function spaces, the proposed method has the ability to find the solution of a high-resolution input after learning from lower-resolution data.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers96
- FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series ForecastingTian Zhou, Ziqing Ma, Qingsong Wen, Xue Wang et al.ICML 2022 · 2,912 citations
- Choose a Transformer: Fourier or GalerkinShuhao CaoNeurIPS 2021 · 516 citations
- FiLM: Frequency improved Legendre Memory Model for Long-term Time Series ForecastingTian Zhou, Ziqing Ma, Xue Wang, Qingsong Wen et al.NeurIPS 2022 · 410 citations
- GNOT: A General Neural Operator Transformer for Operator LearningZhongkai Hao, Zhengyi Wang, Hang Su, Chengyang Ying et al.ICML 2023 · 375 citations
- Transolver: A Fast Transformer Solver for PDEs on General GeometriesHaixu Wu, Huakun Luo, Haowen Wang, Jianmin Wang et al.ICML 2024 · 228 citations
Builds on5
- Fourier Neural Operator for Parametric Partial Differential EquationsZongyi Li, Nikola Borislavov Kovachki, Kamyar Azizzadenesheli, Burigede Liu et al.ICLR 2021 · 3,911 citations
- HiPPO: Recurrent Memory with Optimal Polynomial ProjectionsAlbert Gu, Tri Dao, Stefano Ermon, Atri Rudra et al.NeurIPS 2020 · 1,100 citations
- Neural Controlled Differential Equations for Irregular Time SeriesPatrick Kidger, James Morrill, James Foster, Terry J. LyonsNeurIPS 2020 · 850 citations
- Multipole Graph Neural Operator for Parametric Partial Differential EquationsZongyi Li, Nikola B. Kovachki, Kamyar Azizzadenesheli, Burigede Liu et al.NeurIPS 2020 · 569 citations
- Symplectic Recurrent Neural NetworksZhengdao Chen, Jianyu Zhang, Martín Arjovsky, Léon BottouICLR 2020 · 261 citations
Related papers
- M2NO: An Efficient Multi-Resolution Operator Framework for Dynamic Multi-Scale PDE SolversZhihao Li, Zhilu Lai, Xiaobo Zhang, Wei WangKDD 2026 · 6 citations
- Coupled Multiwavelet Operator Learning for Coupled Differential EquationsXiongye Xiao, Defu Cao, Ruochen Yang, Gaurav Gupta et al.ICLR 2023 · 2 citations
- Learning semilinear neural operators: A unified recursive framework for prediction and data assimilationAshutosh Singh, Ricardo Augusto Borsoi, Deniz Erdogmus, Tales ImbiribaICLR 2024 · 5 citations
- Neural Spectral Methods: Self-supervised learning in the spectral domainYiheng Du, Nithin Chalapathi, Aditi S. KrishnapriyanICLR 2024 · 16 citations
- Non-Linear Operator Approximations for Initial Value ProblemsGaurav Gupta, Xiongye Xiao, Radu V. Balan, Paul BogdanICLR 2022 · 18 citations
