How to Train Your Mamba for Time Series Forecasting
Jiaxi Hu, Disen Lan, Ziyu Zhou, Gefeng Luo, Qingsong Wen, Yuxuan Liang
Abstract
State Space Models (SSMs) have emerged as a powerful framework for sequence modeling in recent years. By approximating continuous dynamical systems and applying discretization techniques, SSMs are particularly well-suited for modeling time-series data. However, despite their growing popularity, most existing applications of SSMs in time-series forecasting treat the models as black boxes. Besides, the underlying mechanisms that contribute to their effectiveness remain unclear, and common claims regarding their advantages in efficiency and expressiveness are not fully substantiated. To address these gaps, this paper establishes a theoretical connection between SSMs and classical spectral transformations from signal processing, thereby providing a more interpretable foundation. Furthermore, we conduct comprehensive ablation studies to examine the properties of different SSM configurations. Our goal is to offer both theoretical insight and empirical guidance for future research on SSM-based approaches in time-series forecasting.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Related papers
- From Generalization Analysis to Optimization Designs for State Space ModelsFusheng Liu, Qianxiao LiICML 2024 · 12 citations
- State Space Models are Provably Comparable to Transformers in Dynamic Token SelectionNaoki Nishikawa, Taiji SuzukiICLR 2025
- SDE: A Simplified and Disentangled Dependency Encoding Framework for State Space Models in Time Series ForecastingZixuan Weng, Jindong Han, Wenzhao Jiang, Hao LiuKDD 2025 · 1 citation
- Universal Redundancies in Time Series Foundation ModelsAnthony Bao, Venkata Hasith Vattikuti, Jeffrey Lai, William GilpinICML 2026 · 2 citations
- State Space Models on Temporal Graphs: A First-Principles StudyJintang Li, Ruofan Wu, Xinzhou Jin, Boqun Ma et al.NeurIPS 2024 · 29 citations
