Meta Guidance: Incorporating Inductive Biases into Deep Time Series Imputers
Jiacheng You, Xinyang Chen, Yu Sun, Weili Guan, Liqiang Nie
Abstract
Missing values, frequently encountered in time series data, can significantly impair the effectiveness of analytical methods. While deep imputation models have emerged as the predominant approach due to their superior performance, explicitly incorporating inductive biases aligned with time-series characteristics offers substantial improvement potential. Taking advantage of non-stationarity and periodicity in time series, two domain-specific inductive biases are designed: (1) Non-Stationary Guidance, which operationalizes the proximity principle to address highly non-stationary series by emphasizing temporal neighbors, and (2) Periodic Guidance, which exploits periodicity patterns through learnable weight allocation across historical periods. Building upon these complementary mechanisms, the overall module, named Meta Guidance, dynamically fuses both guidances through data-adaptive weights learned from the specific input sample. Experiments on nine benchmark datasets demonstrate that integrating Meta Guidance into existing deep imputation architectures achieves an average 27.39% reduction in imputation error compared to state-of-the-art baselines.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on12
- Informer: Beyond Efficient Transformer for Long Sequence Time-Series ForecastingHaoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang et al.AAAI 2021 · 7,289 citations
- Are Transformers Effective for Time Series Forecasting?Ailing Zeng, Muxi Chen, Lei Zhang, Qiang XuAAAI 2023 · 3,619 citations
- iTransformer: Inverted Transformers Are Effective for Time Series ForecastingYong Liu, Tengge Hu, Haoran Zhang, Haixu Wu et al.ICLR 2024 · 1,703 citations
- CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series ImputationYusuke Tashiro, Jiaming Song, Yang Song, Stefano ErmonNeurIPS 2021 · 1,245 citations
- Reversible Instance Normalization for Accurate Time-Series Forecasting against Distribution ShiftTaesung Kim, Jinhee Kim, Yunwon Tae, Cheonbok Park et al.ICLR 2022 · 1,020 citations
Related papers
- Frequency-aware Generative Models for Multivariate Time Series ImputationXinyu Yang, Yu Sun, Xiaojie Yuan, Xinyang ChenNeurIPS 2024 · 41 citations
- Missing Value Imputation on Multidimensional Time SeriesParikshit Bansal, Prathamesh Deshpande, Sunita SarawagiVLDB 2021 · 90 citations
- Networked Time Series Imputation via Position-aware Graph Enhanced Variational AutoencodersDingsu Wang, Yuchen Yan, Ruizhong Qiu, Yada Zhu et al.KDD 2023 · 26 citations
- Collaborative Imputation for Multivariate Time Series with Convergence GuaranteeYu Sun, Xinyu Yang, Shaoxu Song, Ying Zhang et al.ICDE 2025 · 2 citations
- Think Twice Before Imputation: Optimizing Data Imputation Order for Machine LearningJiaxuan Zhang, Haitao Yuan, Jianing Si, Nan Jiang et al.ICDE 2025
