Locally Subspace-Informed Neural Operators for Efficient Multiscale PDE Solving
Alexander Rudikov, Vladimir Fanaskov, Sergei Stepanov, Buzheng Shan, Ekaterina Muravleva, Yalchin Efendiev, Ivan Oseledets
Abstract
We propose GMsFEM-NO, a novel hybrid framework that combines the robustness of the Generalized Multiscale Finite Element Method (GMsFEM) with the computational speed of neural operators (NOs) to create an efficient method for solving heterogeneous partial differential equations (PDEs). GMsFEM builds localized spectral basis functions on coarse grids, allowing it to capture important multiscale features and solve PDEs accurately with less computational effort. However, computing these basis functions is costly. While NOs offer a fast alternative by learning the solution operator directly from data, they can lack robustness. Our approach trains a NO to instantly predict the GMsFEM basis by using a novel subspace-informed loss that learns the entire relevant subspace, not just individual functions. This strategy significantly accelerates the costly offline stage of GMsFEM while retaining its foundation in rigorous numerical analysis, resulting in a solution that is both fast and reliable. On standard multiscale benchmarks—including a linear elliptic diffusion problem and the nonlinear, steady-state Richards equation—our GMsFEM-NO method achieves a reduction in solution error compared to standalone NOs and other hybrid methods. The framework demonstrates effective performance for both 2D and 3D problems. A key advantage is its discretization flexibility: the NO can be trained on a small computational grid and evaluated on a larger one with minimal loss of accuracy, ensuring easy scalability. Furthermore, the resulting solver remains independent of forcing terms, preserving the generalization capabilities of the original GMsFEM approach. Our results prove that combining NO with GMsFEM creates a powerful new type of solver that is both fast and accurate.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on4
- Fourier Neural Operator for Parametric Partial Differential EquationsZongyi Li, Nikola Borislavov Kovachki, Kamyar Azizzadenesheli, Burigede Liu et al.ICLR 2021 · 3,911 citations
- Symbolic Discovery of Optimization AlgorithmsXiangning Chen, Chen Liang, Da Huang, Esteban Real et al.NeurIPS 2023 · 734 citations
- GNOT: A General Neural Operator Transformer for Operator LearningZhongkai Hao, Zhengyi Wang, Hang Su, Chengyang Ying et al.ICML 2023 · 375 citations
- Transolver++: An Accurate Neural Solver for PDEs on Million-Scale GeometriesHuakun Luo, Haixu Wu, Hang Zhou, Lanxiang Xing et al.ICML 2025
Related papers
- G-RANS: Generalizable Residual-Aware Neural Solvers for Sparse SystemsWeixin Liao, Mingquan Feng, Zhizhou Zhang, Youjia Wu et al.ICML 2026
- SVD-NO: Learning PDE Solution Operators with SVD Integral KernelsNoam Koren, Ralf J. J. Mackenbach, Ruud J. G. van Sloun, Kira Radinsky et al.AAAI 2026
- MgNO: Efficient Parameterization of Linear Operators via MultigridJuncai He, Xinliang Liu, Jinchao XuICLR 2024 · 44 citations
- Neural Spectral Methods: Self-supervised learning in the spectral domainYiheng Du, Nithin Chalapathi, Aditi S. KrishnapriyanICLR 2024 · 16 citations
- Neural Operators with Localized Integral and Differential KernelsMiguel Liu-Schiaffini, Julius Berner, Boris Bonev, Thorsten Kurth et al.ICML 2024 · 63 citations
