Bispectral Neural Networks
Sophia Sanborn, Christian Shewmake, Bruno A. Olshausen, Christopher J. Hillar
Abstract
Abstract Compared to ground precipitation measurements, satellite-based precipitation estimation products have the advantage of global coverage and high spatiotemporal resolutions. However, the accuracy of satellite-based precipitation products is still insufficient to serve many weather, climate, and hydrologic applications at high resolutions. In this paper, the authors develop a state-of-the-art deep learning framework for precipitation estimation using bispectral satellite information, infrared (IR), and water vapor (WV) channels. Specifically, a two-stage framework for precipitation estimation from bispectral information is designed, consisting of an initial rain/no-rain (R/NR) binary classification, followed by a second stage estimating the nonzero precipitation amount. In the first stage, the model aims to eliminate the large fraction of NR pixels and to delineate precipitation regions precisely. In the second stage, the model aims to estimate the pointwise precipitation amount accurately while preserving its heavily skewed distribution. Stacked denoising autoencoders (SDAEs), a commonly used deep learning method, are applied in both stages. Performance is evaluated along a number of common performance measures, including both R/NR and real-valued precipitation accuracy, and compared with an operational product, Precipitation Estimation from Remotely Sensed Information Using Artificial Neural Networks–Cloud Classification System (PERSIANN-CCS). For R/NR binary classification, the proposed two-stage model outperforms PERSIANN-CCS by 32.56% in the critical success index (CSI). For real-valued precipitation estimation, the two-stage model is 23.40% lower in average bias, is 44.52% lower in average mean squared error, and has a 27.21% higher correlation coefficient. Hence, the two-stage deep learning framework has the potential to serve as a more accurate and more reliable satellite-based precipitation estimation product. The authors also provide some future directions for development of satellite-based precipitation estimation products in both incorporating auxiliary information and improving retrieval algorithms.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers7
- Pre-trained Large Language Models Use Fourier Features to Compute AdditionTianyi Zhou, Deqing Fu, Vatsal Sharan, Robin JiaNeurIPS 2024 · 48 citations
- Isometric Quotient Variational Auto-Encoders for Structure-Preserving Representation LearningIn Huh, Changwook Jeong, Jae Myung Choe, Younggu Kim et al.NeurIPS 2023 · 10 citations
- A polar prediction model for learning to represent visual transformationsPierre-Étienne H. Fiquet, Eero P. SimoncelliNeurIPS 2023 · 9 citations
- A General Framework for Robust G-Invariance in G-Equivariant NetworksSophia Sanborn, Nina MiolaneNeurIPS 2023 · 8 citations
- The Selective G-Bispectrum and its Inversion: Applications to G-Invariant NetworksSimon Mataigne, Johan Mathe, Sophia Sanborn, Christopher Hillar et al.NeurIPS 2024 · 7 citations
Builds on1
Related papers
- From Swath to Full-Disc: Advancing Precipitation Retrieval with Multimodal Knowledge ExpansionZheng Wang, Kai Ying, Bin Xu, Chunjiao Wang et al.KDD 2025
- Learning Dual Convolutional Dictionaries for Image De-rainingChengjie Ge, Xueyang Fu, Zheng-Jun ZhaACM MM 2022 · 7 citations
- Fourier Amplitude and Correlation Loss: Beyond Using L2 Loss for Skillful Precipitation NowcastingChiu Wai Yan, Shi Quan Foo, Van-Hoan Trinh, Dit-Yan Yeung et al.NeurIPS 2024 · 29 citations
- Multi-Decoding Deraining Network and Quasi-Sparsity Based TrainingYinglong Wang, Chao Ma, Bing ZengCVPR 2021
- Rain Streak Removal via Dual Graph Convolutional NetworkXueyang Fu, Qi Qi, Zheng-Jun Zha, Yurui Zhu et al.AAAI 2021 · 154 citations
