Self-attention-based Diffusion Model for Time-series Imputation in Partial Blackout Scenarios
Mohammad Rafid Ul Islam, Prasad Tadepalli, Alan Fern
Abstract
Missing values in multivariate time series data can harm machine learning performance and introduce bias. These gaps arise from sensor malfunctions, blackouts, and human error and are typically addressed by data imputation. Previous work has tackled the imputation of missing data in random, complete blackouts and forecasting scenarios. The current paper addresses a more general missing pattern, which we call "partial blackout," where a subset of features is missing for consecutive time steps. We introduce a two-stage imputation process using self-attention and diffusion processes to model feature and temporal correlations. Notably, our model effectively handles missing data during training, enhancing adaptability and ensuring reliable imputation and performance, even with incomplete datasets. Our experiments on benchmark and two real-world time series datasets demonstrate that our model outperforms the state-of-the-art in partial blackout scenarios and shows better scalability.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers3
- Step-Aware Residual-Guided Diffusion for EEG Spatial Super-ResolutionHongjun Liu, Leyu Zhou, Zijianghao Yang, Chao YaoICLR 2026 · 8 citations
- Feature Extraction and Representation of Pre-Training Point Cloud Based on Diffusion ModelsChang Qiu, Feipeng Da, Zilei ZhangICCV 2025
- Beyond Observations: Reconstruction Error-Guided Irregularly Sampled Time Series Representation LearningJiexi Liu, Meng Cao, Songcan ChenAAAI 2026
Builds on9
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Improved Denoising Diffusion Probabilistic ModelsAlexander Quinn Nichol, Prafulla DhariwalICML 2021 · 5,234 citations
- DiffWave: A Versatile Diffusion Model for Audio SynthesisZhifeng Kong, Wei Ping, Jiaji Huang, Kexin Zhao et al.ICLR 2021 · 1,902 citations
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar et al.ICLR 2021 · 1,270 citations
- CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series ImputationYusuke Tashiro, Jiaming Song, Yang Song, Stefano ErmonNeurIPS 2021 · 1,245 citations
Related papers
- Imputation-based Time-Series Anomaly Detection with Conditional Weight-Incremental Diffusion ModelsChunjing Xiao, Zehua Gou, Wenxin Tai, Kunpeng Zhang et al.KDD 2023 · 85 citations
- An Observed Value Consistent Diffusion Model for Imputing Missing Values in Multivariate Time SeriesXu Wang, Hongbo Zhang, Pengkun Wang, Yudong Zhang et al.KDD 2023 · 43 citations
- DIM-SUM: Dynamic IMputation for Smart Utility ManagementRyan Hildebrant, Rahul Atul Bhope, Sharad Mehrotra, Christopher Tull et al.VLDB 2025 · 2 citations
- PriSTI: A Conditional Diffusion Framework for Spatiotemporal ImputationMingzhe Liu, Han Huang, Hao Feng, Leilei Sun et al.ICDE 2023 · 110 citations
- Probabilistic Imputation for Time-series Classification with Missing DataSeunghyun Kim, Hyunsu Kim, Eunggu Yun, Hwangrae Lee et al.ICML 2023 · 37 citations
