Lune

ICLR2025顶会

S4M: S4 for multivariate time series forecasting with Missing values

Peng Jing, Meiqi Yang, Qiong Zhang, Xiaoxiao Li

问 Lune

摘要

Multivariate time series data play a pivotal role in a wide range of real-world applications, such as finance, healthcare, and meteorology, where accurate forecasting is critical for informed decision-making and proactive interventions. However, the presence of block missing data introduces significant challenges, often compromising the performance of predictive models. Traditional two-step approaches, which first impute missing values and then perform forecasting, are prone to error accumulation, particularly in complex multivariate settings characterized by high missing ratios and intricate dependency structures. In this work, we introduce S4M, an end-to-end time series forecasting framework that seamlessly integrates missing data handling into the Structured State Space Sequence (S4) model architecture. Unlike conventional methods that treat imputation as a separate preprocessing step, S4M leverages the latent space of S4 models to directly recognize and represent missing data patterns, thereby more effectively capturing the underlying temporal and multivariate dependencies. Our framework comprises two key components: the Adaptive Temporal Prototype Mapper (ATPM) and the Missing-Aware Dual Stream S4 (MDS-S4). The ATPM employs a prototype bank to derive robust and informative representations from historical data patterns, while the MDS-S4 processes these representations alongside missingness masks as dual input streams to enable accurate forecasting. Through extensive empirical evaluations on diverse real-world datasets, we demonstrate that S4M consistently achieves state-of-the-art performance. These results underscore the efficacy of our integrated approach in handling missing data, showcasing its robustness and superiority over traditional imputation-based methods. Our findings highlight the potential of S4M to advance reliable time series forecasting in practical applications, offering a promising direction for future research and deployment. Code is available at https://github.com/WINTERWEEL/S4M.git.

问 Lune

尽管问,回答会引用原文。

Lune 会读完全文和相关的 Paper,每个回答都附上所依据的原文段落。

可以从这些问题问起

Lune 的依据

全文 · 引用它的 2 篇顶会 Paper · 相关的 Paper

获取答案

免费开始,无需绑卡

引用它的顶会 Paper2

  1. SciTS: Scientific Time Series Understanding and Generation with LLMsWen Wu, Ziyang Zhang, Liwei Liu, Xuenan Xu 等ICLR 2026 · 11 次引用
  2. Towards Robust Real-World Multivariate Time Series Forecasting: A Unified Framework for Dependency, Asynchrony, and MissingnessJinkwan Jang, Hyungjin Park, Jinmyeong Choi, Taesup KimICLR 2026 · 2 次引用

它引用的 Paper16

  1. Informer: Beyond Efficient Transformer for Long Sequence Time-Series ForecastingHaoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang 等AAAI 2021 · 7,289 次引用
  2. Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series ForecastingHaixu Wu, Jiehui Xu, Jianmin Wang, Mingsheng LongNeurIPS 2021 · 5,824 次引用
  3. Efficiently Modeling Long Sequences with Structured State SpacesAlbert Gu, Karan Goel, Christopher RéICLR 2022 · 3,482 次引用
  4. iTransformer: Inverted Transformers Are Effective for Time Series ForecastingYong Liu, Tengge Hu, Haoran Zhang, Haixu Wu 等ICLR 2024 · 1,703 次引用
  5. HiPPO: Recurrent Memory with Optimal Polynomial ProjectionsAlbert Gu, Tri Dao, Stefano Ermon, Atri Rudra 等NeurIPS 2020 · 1,100 次引用

相关 Paper

  1. Joint Modeling of Local and Global Temporal Dynamics for Multivariate Time Series Forecasting with Missing ValuesXianfeng Tang, Huaxiu Yao, Yiwei Sun, Charu C. Aggarwal 等AAAI 2020 · 138 次引用
  2. Rethinking Irregular Time Series Forecasting: A Simple Yet Effective BaselineXvyuan Liu, Xiangfei Qiu, Xingjian Wu, Zhengyu Li 等AAAI 2026 · 42 次引用
  3. Self-attention-based Diffusion Model for Time-series Imputation in Partial Blackout ScenariosMohammad Rafid Ul Islam, Prasad Tadepalli, Alan FernAAAI 2025 · 10 次引用
  4. Mining of Switching Sparse Networks for Missing Value Imputation in Multivariate Time SeriesKohei Obata, Koki Kawabata, Yasuko Matsubara, Yasushi SakuraiKDD 2024 · 6 次引用
  5. SMART: Towards Pre-trained Missing-Aware Model for Patient Health Status PredictionZhihao Yu, Chu Xu, Yujie Jin, Yasha Wang 等NeurIPS 2024 · 19 次引用
黄昏的海面,两侧是细线勾勒的悬崖