OrthoSolver: A Neural Proper Orthogonal Decomposition Solver For PDEs
Ying Pang, Jingyuan Wang, Jiahao Ji, Fanhao Mu
Abstract
Proper Orthogonal Decomposition (POD) is a cornerstone reduced-order modeling technique for accelerating the solution of partial differential equations (PDEs) by extracting energy-optimal orthogonal bases. However, POD's inherent linear assumption limits its expressive power for complex nonlinear dynamics, and its snapshot-based fixed bases generalize poorly to unseen scenarios. Meanwhile, emerging deep learning solvers have explored integrating decomposition architectures, yet their purely data-driven nature lacks essential physical priors and leads to modal collapse, where decomposed modes lose discriminative power. To address these challenges, we revisit POD from an information-theoretic perspective. We theoretically establish that POD's classical energy-maximization criterion is, in essence, a principle of maximizing mutual information. Guided by this insight, we propose OrthoSolver, a neural proper orthogonal decomposition framework that generalizes this core information-theoretic principle to the nonlinear domain. OrthoSolver iteratively and adaptively extracts a set of compact and expressive nonlinear basis modes by directly maximizing their mutual information with the data field. Furthermore, an orthogonality regularization is imposed to preserve the diversity of the learned modes and effectively mitigate mode collapse. Extensive experiments on seven PDE benchmarks demonstrate that OrthoSolver consistently outperforms state-of-the-art deep learning baselines.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on12
- Fourier Neural Operator for Parametric Partial Differential EquationsZongyi Li, Nikola Borislavov Kovachki, Kamyar Azizzadenesheli, Burigede Liu et al.ICLR 2021 · 3,911 citations
- CLUB: A Contrastive Log-ratio Upper Bound of Mutual InformationPengyu Cheng, Weituo Hao, Shuyang Dai, Jiachang Liu et al.ICML 2020 · 512 citations
- GNOT: A General Neural Operator Transformer for Operator LearningZhongkai Hao, Zhengyi Wang, Hang Su, Chengyang Ying et al.ICML 2023 · 375 citations
- Multiwavelet-based Operator Learning for Differential EquationsGaurav Gupta, Xiongye Xiao, Paul BogdanNeurIPS 2021 · 355 citations
- Transolver: A Fast Transformer Solver for PDEs on General GeometriesHaixu Wu, Huakun Luo, Haowen Wang, Jianmin Wang et al.ICML 2024 · 228 citations
Related papers
- Origo: Interpretable Multi-physics PDE Foundation Model through Neural Operator SplittingLi Sun, Hongbo Lv, Zhikai Jiang, Zhongtian Sun et al.ICML 2026
- Unisolver: PDE-Conditional Transformers Towards Universal Neural PDE SolversHang Zhou, Yuezhou Ma, Haixu Wu, Haowen Wang et al.ICML 2025
- CROM: Continuous Reduced-Order Modeling of PDEs Using Implicit Neural RepresentationsPeter Yichen Chen, Jinxu Xiang, Dong Heon Cho, Yue Chang et al.ICLR 2023 · 11 citations
- Revisiting Orbital Minimization Method for Neural Operator DecompositionJongha Ryu, Samuel Zhou, Gregory W. WornellNeurIPS 2025 · 1 citation
- Poisson-Dirac Neural Networks for Modeling Coupled Dynamical Systems across DomainsRazmik Arman Khosrovian, Takaharu Yaguchi, Hiroaki Yoshimura, Takashi MatsubaraICLR 2025
