Spherical Fourier Neural Operators: Learning Stable Dynamics on the Sphere
Boris Bonev, Thorsten Kurth, Christian Hundt, Jaideep Pathak, Maximilian Baust, Karthik Kashinath, Anima Anandkumar
Abstract
Fourier Neural Operators (FNOs) have proven to be an efficient and effective method for resolution-independent operator learning in a broad variety of application areas across scientific machine learning. A key reason for their success is their ability to accurately model long-range dependencies in spatio-temporal data by learning global convolutions in a computationally efficient manner. To this end, FNOs rely on the discrete Fourier transform (DFT), however, DFTs cause visual and spectral artifacts as well as pronounced dissipation when learning operators in spherical coordinates since they incorrectly assume a flat geometry. To overcome this limitation, we generalize FNOs on the sphere, introducing Spherical FNOs (SFNOs) for learning operators on spherical geometries. We apply SFNOs to forecasting atmospheric dynamics, and demonstrate stable auto-regressive rollouts for a year of simulated time (1,460 steps), while retaining physically plausible dynamics. The SFNO has important implications for machine learning-based simulation of climate dynamics that could eventually help accelerate our response to climate change.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers56
- Poseidon: Efficient Foundation Models for PDEsMaximilian Herde, Bogdan Raonic, Tobias Rohner, Roger Käppeli et al.NeurIPS 2024 · 235 citations
- DiffusionPDE: Generative PDE-Solving under Partial ObservationJiahe Huang, Guandao Yang, Zichen Wang, Jeong Joon ParkNeurIPS 2024 · 148 citations
- Pretraining Codomain Attention Neural Operators for Solving Multiphysics PDEsMd. Ashiqur Rahman, Robert Joseph George, Mogab Elleithy, Daniel V. Leibovici et al.NeurIPS 2024 · 79 citations
- Neural Operators with Localized Integral and Differential KernelsMiguel Liu-Schiaffini, Julius Berner, Boris Bonev, Thorsten Kurth et al.ICML 2024 · 63 citations
- Probabilistic Weather Forecasting with Hierarchical Graph Neural NetworksJoel Oskarsson, Tomas Landelius, Marc Peter Deisenroth, Fredrik LindstenNeurIPS 2024 · 44 citations
Builds on6
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- Fourier Neural Operator for Parametric Partial Differential EquationsZongyi Li, Nikola Borislavov Kovachki, Kamyar Azizzadenesheli, Burigede Liu et al.ICLR 2021 · 3,911 citations
- Is Space-Time Attention All You Need for Video Understanding?Gedas Bertasius, Heng Wang, Lorenzo TorresaniICML 2021 · 2,927 citations
- Alias-Free Generative Adversarial NetworksTero Karras, Miika Aittala, Samuli Laine, Erik Härkönen et al.NeurIPS 2021 · 2,126 citations
- Scalable and Equivariant Spherical CNNs by Discrete-Continuous (DISCO) ConvolutionsJeremy Ocampo, Matthew A. Price, Jason D. McEwenICLR 2023 · 5 citations
Related papers
- Generalized Spherical Neural Operators: Green's Function FormulationHao Tang, Hao Chen, Chao LiICLR 2026 · 3 citations
- Beyond Regular Grids: Fourier-Based Neural Operators on Arbitrary DomainsLevi E. Lingsch, Mike Yan Michelis, Emmanuel de Bézenac, Sirani M. Perera et al.ICML 2024 · 24 citations
- Shifting Time: Time-series Forecasting with Khatri-Rao Neural OperatorsSrinath Dama, Kevin Course, Prasanth B. NairICML 2025
- Discretization-invariance? On the Discretization Mismatch Errors in Neural OperatorsWenhan Gao, Ruichen Xu, Yuefan Deng, Yi LiuICLR 2025
- FNOPE: Simulation-based inference on function spaces with Fourier Neural OperatorsGuy Moss, Leah Sophie Muhle, Reinhard Drews, Jakob H. Macke et al.NeurIPS 2025 · 3 citations
