Sensitivity-Constrained Fourier Neural Operators for Forward and Inverse Problems in Parametric Differential Equations
Abdolmehdi Behroozi, Chaopeng Shen, Daniel Kifer
Abstract
Parametric differential equations of the form ∂u ∂t = f (u, x, t, p) are fundamental in science and engineering. While deep learning frameworks like the Fourier Neural Operator (FNO) efficiently approximate differential equation solutions, they struggle with inverse problems, sensitivity calculations ∂u ∂p , and concept drift. We address these challenges by introducing a novel sensitivity loss regularizer, demonstrated through Sensitivity-Constrained Fourier Neural Operators (SC-FNO). Our approach maintains high accuracy for solution paths and outperforms both standard FNO and FNO with Physics-Informed Neural Network regularization. SC-FNO exhibits superior performance in parameter inversion tasks, accommodates more complex parameter spaces (tested with up to 82 parameters), reduces training data requirements, and decreases training time while maintaining accuracy. These improvements apply across various differential equations and neural operators, enhancing their reliability without significant computational overhead (30%-130% extra training time per epoch). Models and selected experiment code are available at: https://github.com/AMBehroozi/SC_Neural_Operators .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e615e117-e121-4d15-abf4-144e4e7c19a6Cited by top-tier papers2
- FNOPE: Simulation-based inference on function spaces with Fourier Neural OperatorsGuy Moss, Leah Sophie Muhle, Reinhard Drews, Jakob H. Macke et al.NeurIPS 2025 · 3 citations
- Generalized Spherical Neural Operators: Green's Function FormulationHao Tang, Hao Chen, Chao LiICLR 2026 · 3 citations
Builds on4
- Fourier Neural Operator for Parametric Partial Differential EquationsZongyi Li, Nikola Borislavov Kovachki, Kamyar Azizzadenesheli, Burigede Liu et al.ICLR 2021 · 3,911 citations
- Multiwavelet-based Operator Learning for Differential EquationsGaurav Gupta, Xiongye Xiao, Paul BogdanNeurIPS 2021 · 355 citations
- Spherical Fourier Neural Operators: Learning Stable Dynamics on the SphereBoris Bonev, Thorsten Kurth, Christian Hundt, Jaideep Pathak et al.ICML 2023 · 280 citations
- JAX MD: A Framework for Differentiable PhysicsSamuel S. Schoenholz, Ekin Dogus CubukNeurIPS 2020 · 195 citations
Related papers
- Derivative-enhanced Deep Operator NetworkYuan Qiu, Nolan Bridges, Peng ChenNeurIPS 2024 · 25 citations
- Component Fourier Neural Operator for Singularly Perturbed Differential EquationsYe Li, Ting Du, Yiwen Pang, Zhongyi HuangAAAI 2024 · 6 citations
- Maximal Update Parametrization and Zero-Shot Hyperparameter Transfer for Fourier Neural OperatorsShanda Li, Shinjae Yoo, Yiming YangICML 2025
- Solving Differential Equations with Constrained LearningViggo Moro, Luiz F. O. ChamonICLR 2025
- Characterizing possible failure modes in physics-informed neural networksAditi S. Krishnapriyan, Amir Gholami, Shandian Zhe, Robert M. Kirby et al.NeurIPS 2021 · 1,421 citations
