How to Train Your Mamba for Time Series Forecasting
Jiaxi Hu, Disen Lan, Ziyu Zhou, Gefeng Luo, Qingsong Wen, Yuxuan Liang
摘要
State Space Models (SSMs) have emerged as a powerful framework for sequence modeling in recent years. By approximating continuous dynamical systems and applying discretization techniques, SSMs are particularly well-suited for modeling time-series data. However, despite their growing popularity, most existing applications of SSMs in time-series forecasting treat the models as black boxes. Besides, the underlying mechanisms that contribute to their effectiveness remain unclear, and common claims regarding their advantages in efficiency and expressiveness are not fully substantiated. To address these gaps, this paper establishes a theoretical connection between SSMs and classical spectral transformations from signal processing, thereby providing a more interpretable foundation. Furthermore, we conduct comprehensive ablation studies to examine the properties of different SSM configurations. Our goal is to offer both theoretical insight and empirical guidance for future research on SSM-based approaches in time-series forecasting.
问问这篇 Paper
问问你的智能体。
Lune 读过与它相关的顶会 Paper,每个回答都会注明依据哪几篇。
相关 Paper
- From Generalization Analysis to Optimization Designs for State Space ModelsFusheng Liu, Qianxiao LiICML 2024 · 被引用 12 次
- State Space Models are Provably Comparable to Transformers in Dynamic Token SelectionNaoki Nishikawa, Taiji SuzukiICLR 2025
- SDE: A Simplified and Disentangled Dependency Encoding Framework for State Space Models in Time Series ForecastingZixuan Weng, Jindong Han, Wenzhao Jiang, Hao LiuKDD 2025 · 被引用 1 次
- Universal Redundancies in Time Series Foundation ModelsAnthony Bao, Venkata Hasith Vattikuti, Jeffrey Lai, William GilpinICML 2026 · 被引用 2 次
- State Space Models on Temporal Graphs: A First-Principles StudyJintang Li, Ruofan Wu, Xinzhou Jin, Boqun Ma 等NeurIPS 2024 · 被引用 29 次
