SSIN: Self-Supervised Learning for Rainfall Spatial Interpolation
Jia Li, Yanyan Shen, Lei Chen, Charles Wang Wai Ng
Abstract
The acquisition of accurate rainfall distribution in space is an important task in hydrological analysis and natural disaster pre-warning. However, it is impossible to install rain gauges on every corner. Spatial interpolation is a common way to infer rainfall distribution based on available raingauge data. However, the existing works rely on some unrealistic pre-settings to capture spatial correlations, which limits their performance in real scenarios. To tackle this issue, we propose the SSIN, which is a novel data-driven self-supervised learning framework for rainfall spatial interpolation by mining latent spatial patterns from historical observation data. Inspired by the Cloze task and BERT, we fully consider the characteristics of spatial interpolation and design the SpaFormer model based on the Transformer architecture as the core of SSIN. Our main idea is: by constructing rich self-supervision signals via random masking, SpaFormer can learn informative embeddings for raw data and then adaptively model spatial correlations based on rainfall spatial context. Extensive experiments on two real-world raingauge datasets show that our method outperforms the state-of-the-art solutions. In addition, we take traffic spatial interpolation as another use case to further explore the performance of our method, and SpaFormer achieves the best performance on one large real-world traffic dataset, which further confirms the effectiveness and generality of our method.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 5fdad4a1-b14c-4e16-81fb-2da11b0376a2Cited by top-tier papers3
- GeoAggregator: An Efficient Transformer Model for Geo-Spatial Tabular DataRui Deng, Ziqi Li, Mingshu WangAAAI 2025 · 1 citation
- Efficient GNN Training on Giant Graphs with Collective Batching and SchedulingXin Zhang, Yanyan Shen, Yingxia Shao, Haoyang Li et al.VLDB 2026
- AnchorGK: Anchor-based Incremental and Stratified Graph Learning Framework for Inductive Spatio-Temporal KrigingXiaobin Ren, Kaiqi Zhao, Katerina Taskova, Patricia RiddleKDD 2026
Builds on7
- data2vec: A General Framework for Self-supervised Learning in Speech, Vision and LanguageAlexei Baevski, Wei-Ning Hsu, Qiantong Xu, Arun Babu et al.ICML 2022 · 1,123 citations
- Rethinking Positional Encoding in Language Pre-trainingGuolin Ke, Di He, Tie-Yan LiuICLR 2021 · 358 citations
- Efficient Self-supervised Vision Transformers for Representation LearningChunyuan Li, Jianwei Yang, Pengchuan Zhang, Mei Gao et al.ICLR 2022 · 228 citations
- Inductive Graph Neural Networks for Spatiotemporal KrigingYuankai Wu, Dingyi Zhuang, Aurélie Labbe, Lijun SunAAAI 2021 · 200 citations
- Kriging Convolutional NetworksGabriel Appleby, Linfeng Liu, Liping LiuAAAI 2020 · 93 citations
Related papers
- SSL-STMFormer Self-Supervised Learning Spatio-Temporal Entanglement Transformer for Traffic Flow PredictionZetao Li, Zheng Hu, Peng Han, Yu Gu et al.AAAI 2025 · 12 citations
- LLGformer: Learnable Long-range Graph Transformer for Traffic Flow PredictionDi Jin, Cuiying Huo, Jiayi Shi, Dongxiao He et al.WWW 2025 · 14 citations
- RainMamba: Enhanced Locality Learning with State Space Models for Video DerainingHongtao Wu, Yijun Yang, Huihui Xu, Weiming Wang et al.ACM MM 2024 · 51 citations
- Trafformer: Unify Time and Space in Traffic PredictionDi Jin, Jiayi Shi, Rui Wang, Yawen Li et al.AAAI 2023 · 60 citations
- CSTDFormer: Empowering Transformers to Learn Spatio-Temporal Delays via Contrastive LearningEn Wang, Jiajian Lv, Di Liang, Zidie Zhou et al.INFOCOM 2026
