G-RANS: Generalizable Residual-Aware Neural Solvers for Sparse Systems
Weixin Liao, Mingquan Feng, Zhizhou Zhang, Youjia Wu, Yifan Fu, Junchi Yan
Abstract
Neural operators have shown promise in accelerating PDE solvers, yet they remain unreliable for the sparse linear systems induced by discretization due to limited generalization across physical parameters and insufficient accuracy, and hybrid neural iterative schemes face stagnation as the residual distribution evolves over iterations. To address these limitations, we propose G-RANS (Generalizable Residual-Aware Neural Solver), a neuralized iterative paradigm that performs residual-aware subspace corrections by mapping the residual to the matrix graph, generating multi-scale correction subspaces via a residual-aware basis generator, and applying projected updates through a differentiable subspace projection. G-RANS is trained fully self-supervised via progressive bootstrap with multi-stage residual distributions. On sparse FEM systems from a representative suite of second-order elliptic PDEs (Poisson, advection--diffusion, reaction--diffusion, and Helmholtz), G-RANS is robust to severe coefficient shifts (up to ) and shows strong cross-equation generalization. G-RANS reaches relative residuals on the order of , substantially outperforming end-to-end neural operators, and attains the same target residual with -- less wall-clock time than classical Krylov solvers.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f782dc42-2934-48bd-bb87-dcfcd3215e73Builds on7
- Fourier Neural Operator for Parametric Partial Differential EquationsZongyi Li, Nikola Borislavov Kovachki, Kamyar Azizzadenesheli, Burigede Liu et al.ICLR 2021 · 3,911 citations
- How Attentive are Graph Attention Networks?Shaked Brody, Uri Alon, Eran YahavICLR 2022 · 1,717 citations
- Learning Preconditioners for Conjugate Gradient PDE SolversYichen Li, Peter Yichen Chen, Tao Du, Wojciech MatusikICML 2023 · 38 citations
- Neural Krylov Iteration for Accelerating Linear System SolvingJian Luo, Jie Wang, Hong Wang, Huanshuo Dong et al.NeurIPS 2024 · 23 citations
- A Deep Conjugate Direction Method for Iteratively Solving Linear SystemsAyano Kaneda, Osman Akar, Jingyu Chen, Victoria Alicia Trevino Kala et al.ICML 2023 · 17 citations
Related papers
- Locally Subspace-Informed Neural Operators for Efficient Multiscale PDE SolvingAlexander Rudikov, Vladimir Fanaskov, Sergei Stepanov, Buzheng Shan et al.ICLR 2026 · 4 citations
- RIGNO: A Graph-based Framework For Robust And Accurate Operator Learning For PDEs On Arbitrary DomainsSepehr Mousavi, Shizheng Wen, Levi E. Lingsch, Maximilian Herde et al.NeurIPS 2025 · 31 citations
- RAPNet: Accelerating Algebraic Multigrid with Learned Sparse CorrectionsYali Fink, Ido Ben-Yair, Lars Ruthotto, Eran TreisterICML 2026
- Graph Neural Preconditioners for Iterative Solutions of Sparse Linear SystemsJie ChenICLR 2025
- PRDP: Progressively Refined Differentiable PhysicsKanishk Bhatia, Felix Koehler, Nils ThuereyICLR 2025
