WaveDiST: A Wavelet Diffusion Transformer for Spatio-Temporal Estimation on Unobserved Locations
Huiling Qin, Yuanxun Li, Weijia Jia
Abstract
Spatio-temporal estimation plays a vital role in numerous scientific and engineering tasks, particularly for novel or unobserved locations lacking historical references. Many areas remain unobserved by sensors due to their non-core location or pending development status. The states of these areas can only be estimated through similar nodes in the geospace, rather than through historical data with temporal trends. Estimating these unobserved node states is crucial for city-wide spatio-temporal sensing and urban development, extending beyond simple point or block data imputation. In this study, we introduce a diffusion point process in high-frequency space to develop a robust spatio-temporal diffusion transformer for urban estimation where partial historical reference data is lacking. Our approach decomposes spatio-temporal data into high and low-frequency components through wavelet transform, and trains a diffusion model of spatial temporal data with a transformer that operates on high frequency signals. We incorporate low-frequency signals as diffusion conditions in the transformer architecture to capture overall spatio-temporal profiles and gradual trends. To enhance the learning of each step, we design an diffusion model featuring a spatio-temporal attention module that adaptively captures interdependencies between time and space. Extensive experiments across diverse domains including traffic, economics, and environment demonstrate that our method significantly outperforms state-of-the-art baselines.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d617ee9e-14b4-4f4f-89ad-d72b406e7c9eBuilds on20
- Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series ForecastingHaixu Wu, Jiehui Xu, Jianmin Wang, Mingsheng LongNeurIPS 2021 · 5,824 citations
- Scalable Diffusion Models with TransformersWilliam Peebles, Saining XieICCV 2023 · 5,568 citations
- Improved Denoising Diffusion Probabilistic ModelsAlexander Quinn Nichol, Prafulla DhariwalICML 2021 · 5,234 citations
- CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series ImputationYusuke Tashiro, Jiaming Song, Yang Song, Stefano ErmonNeurIPS 2021 · 1,245 citations
- Spatial-Temporal Fusion Graph Neural Networks for Traffic Flow ForecastingMengzhang Li, Zhanxing ZhuAAAI 2021 · 1,037 citations
Related papers
- Spatiotemporal Transformer for Data Inference and Long Prediction in Sparse Mobile CrowdSensingEn Wang, Weiting Liu, Wenbin Liu, Chaocan Xiang et al.INFOCOM 2023 · 22 citations
- Diffusion Transformers for Imputation: Statistical Efficiency and Uncertainty QuantificationZeqi Ye, Minshuo ChenNeurIPS 2025
- Diffusion-based Kriging Model with Graph-enhanced AttentionMingtao Zhang, Guoli Yang, Zhanxing Zhu, Guangyin Jin et al.WWW 2026
- Generative Human Trajectory Recovery via Embedding-Space Conditional DiffusionKaijun Liu, Sijie Ruan, Liang Zhang, Cheng Long et al.ICML 2025
- A Hierarchical Spatial Transformer for Massive Point Samples in Continuous SpaceWenchong He, Zhe Jiang, Tingsong Xiao, Zelin Xu et al.NeurIPS 2023 · 20 citations
