Lune

ICLR2025Top-tier venue

S4M: S4 for multivariate time series forecasting with Missing values

Peng Jing, Meiqi Yang, Qiong Zhang, Xiaoxiao Li

Abstract

Multivariate time series data play a pivotal role in a wide range of real-world applications, such as finance, healthcare, and meteorology, where accurate forecasting is critical for informed decision-making and proactive interventions. However, the presence of block missing data introduces significant challenges, often compromising the performance of predictive models. Traditional two-step approaches, which first impute missing values and then perform forecasting, are prone to error accumulation, particularly in complex multivariate settings characterized by high missing ratios and intricate dependency structures. In this work, we introduce S4M, an end-to-end time series forecasting framework that seamlessly integrates missing data handling into the Structured State Space Sequence (S4) model architecture. Unlike conventional methods that treat imputation as a separate preprocessing step, S4M leverages the latent space of S4 models to directly recognize and represent missing data patterns, thereby more effectively capturing the underlying temporal and multivariate dependencies. Our framework comprises two key components: the Adaptive Temporal Prototype Mapper (ATPM) and the Missing-Aware Dual Stream S4 (MDS-S4). The ATPM employs a prototype bank to derive robust and informative representations from historical data patterns, while the MDS-S4 processes these representations alongside missingness masks as dual input streams to enable accurate forecasting. Through extensive empirical evaluations on diverse real-world datasets, we demonstrate that S4M consistently achieves state-of-the-art performance. These results underscore the efficacy of our integrated approach in handling missing data, showcasing its robustness and superiority over traditional imputation-based methods. Our findings highlight the potential of S4M to advance reliable time series forecasting in practical applications, offering a promising direction for future research and deployment. Code is available at https://github.com/WINTERWEEL/S4M.git.

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · 2 top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Cited by top-tier papers2

  1. SciTS: Scientific Time Series Understanding and Generation with LLMsWen Wu, Ziyang Zhang, Liwei Liu, Xuenan Xu et al.ICLR 2026 · 11 citations
  2. Towards Robust Real-World Multivariate Time Series Forecasting: A Unified Framework for Dependency, Asynchrony, and MissingnessJinkwan Jang, Hyungjin Park, Jinmyeong Choi, Taesup KimICLR 2026 · 2 citations

Builds on16

  1. Informer: Beyond Efficient Transformer for Long Sequence Time-Series ForecastingHaoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang et al.AAAI 2021 · 7,289 citations
  2. Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series ForecastingHaixu Wu, Jiehui Xu, Jianmin Wang, Mingsheng LongNeurIPS 2021 · 5,824 citations
  3. Efficiently Modeling Long Sequences with Structured State SpacesAlbert Gu, Karan Goel, Christopher RéICLR 2022 · 3,482 citations
  4. iTransformer: Inverted Transformers Are Effective for Time Series ForecastingYong Liu, Tengge Hu, Haoran Zhang, Haixu Wu et al.ICLR 2024 · 1,703 citations
  5. HiPPO: Recurrent Memory with Optimal Polynomial ProjectionsAlbert Gu, Tri Dao, Stefano Ermon, Atri Rudra et al.NeurIPS 2020 · 1,100 citations

Related papers

  1. Joint Modeling of Local and Global Temporal Dynamics for Multivariate Time Series Forecasting with Missing ValuesXianfeng Tang, Huaxiu Yao, Yiwei Sun, Charu C. Aggarwal et al.AAAI 2020 · 138 citations
  2. Rethinking Irregular Time Series Forecasting: A Simple Yet Effective BaselineXvyuan Liu, Xiangfei Qiu, Xingjian Wu, Zhengyu Li et al.AAAI 2026 · 42 citations
  3. Self-attention-based Diffusion Model for Time-series Imputation in Partial Blackout ScenariosMohammad Rafid Ul Islam, Prasad Tadepalli, Alan FernAAAI 2025 · 10 citations
  4. Mining of Switching Sparse Networks for Missing Value Imputation in Multivariate Time SeriesKohei Obata, Koki Kawabata, Yasuko Matsubara, Yasushi SakuraiKDD 2024 · 6 citations
  5. SMART: Towards Pre-trained Missing-Aware Model for Patient Health Status PredictionZhihao Yu, Chu Xu, Yujie Jin, Yasha Wang et al.NeurIPS 2024 · 19 citations
Dusk over the sea between two cliffs drawn in fine vertical lines