SSIN: Self-Supervised Learning for Rainfall Spatial Interpolation
Jia Li, Yanyan Shen, Lei Chen, Charles Wang Wai Ng
摘要
The acquisition of accurate rainfall distribution in space is an important task in hydrological analysis and natural disaster pre-warning. However, it is impossible to install rain gauges on every corner. Spatial interpolation is a common way to infer rainfall distribution based on available raingauge data. However, the existing works rely on some unrealistic pre-settings to capture spatial correlations, which limits their performance in real scenarios. To tackle this issue, we propose the SSIN, which is a novel data-driven self-supervised learning framework for rainfall spatial interpolation by mining latent spatial patterns from historical observation data. Inspired by the Cloze task and BERT, we fully consider the characteristics of spatial interpolation and design the SpaFormer model based on the Transformer architecture as the core of SSIN. Our main idea is: by constructing rich self-supervision signals via random masking, SpaFormer can learn informative embeddings for raw data and then adaptively model spatial correlations based on rainfall spatial context. Extensive experiments on two real-world raingauge datasets show that our method outperforms the state-of-the-art solutions. In addition, we take traffic spatial interpolation as another use case to further explore the performance of our method, and SpaFormer achieves the best performance on one large real-world traffic dataset, which further confirms the effectiveness and generality of our method.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper3
- GeoAggregator: An Efficient Transformer Model for Geo-Spatial Tabular DataRui Deng, Ziqi Li, Mingshu WangAAAI 2025 · 被引用 1 次
- Efficient GNN Training on Giant Graphs with Collective Batching and SchedulingXin Zhang, Yanyan Shen, Yingxia Shao, Haoyang Li 等VLDB 2026
- AnchorGK: Anchor-based Incremental and Stratified Graph Learning Framework for Inductive Spatio-Temporal KrigingXiaobin Ren, Kaiqi Zhao, Katerina Taskova, Patricia RiddleKDD 2026
它引用的顶会 Paper7
- data2vec: A General Framework for Self-supervised Learning in Speech, Vision and LanguageAlexei Baevski, Wei-Ning Hsu, Qiantong Xu, Arun Babu 等ICML 2022 · 被引用 1,123 次
- Rethinking Positional Encoding in Language Pre-trainingGuolin Ke, Di He, Tie-Yan LiuICLR 2021 · 被引用 358 次
- Efficient Self-supervised Vision Transformers for Representation LearningChunyuan Li, Jianwei Yang, Pengchuan Zhang, Mei Gao 等ICLR 2022 · 被引用 228 次
- Inductive Graph Neural Networks for Spatiotemporal KrigingYuankai Wu, Dingyi Zhuang, Aurélie Labbe, Lijun SunAAAI 2021 · 被引用 200 次
- Kriging Convolutional NetworksGabriel Appleby, Linfeng Liu, Liping LiuAAAI 2020 · 被引用 93 次
相关 Paper
- SSL-STMFormer Self-Supervised Learning Spatio-Temporal Entanglement Transformer for Traffic Flow PredictionZetao Li, Zheng Hu, Peng Han, Yu Gu 等AAAI 2025 · 被引用 12 次
- LLGformer: Learnable Long-range Graph Transformer for Traffic Flow PredictionDi Jin, Cuiying Huo, Jiayi Shi, Dongxiao He 等WWW 2025 · 被引用 14 次
- RainMamba: Enhanced Locality Learning with State Space Models for Video DerainingHongtao Wu, Yijun Yang, Huihui Xu, Weiming Wang 等ACM MM 2024 · 被引用 51 次
- Trafformer: Unify Time and Space in Traffic PredictionDi Jin, Jiayi Shi, Rui Wang, Yawen Li 等AAAI 2023 · 被引用 60 次
- CSTDFormer: Empowering Transformers to Learn Spatio-Temporal Delays via Contrastive LearningEn Wang, Jiajian Lv, Di Liang, Zidie Zhou 等INFOCOM 2026
