What If We Let Forecasting Forget? A Sparse Bottleneck for Cross-Variable Dependencies
Fan Zhang, Shiming Fan, Hua Wang
Abstract
Multivariate time series forecasting is critical in many real-world systems, and thus modeling cross-channel dependencies is essential. Although existing methods improve overall accuracy by enhancing representations and cross-channel interactions, it remains challenging to reliably capture inter-variable dependencies under specific conditions. We observe that dependencies in real data are often state-dependent and noisy; in such cases, dense interactions can amplify spurious correlations and lead to representation over-smoothing, which may yield unreliable predictions in certain scenarios. Motivated by this, we propose MS-FLOW, a sparse-bottleneck framework that explicitly models inter-variable interaction as capacity-limited information flow. Specifically, MS-FLOW replaces fully connected communication with selective sparse routing, retaining only a few critical dependency paths and injecting cross-variable signals under a strict communication budget, thereby suppressing redundant connections and spurious-correlation propagation. Extensive experiments demonstrate that MS-FLOW learns more reliable multivariate correlations, achieving state-of-the-art forecasting accuracy on 12 real-world benchmarks while producing fewer yet more reliable dependencies, shifting multivariate forecasting from “more interaction” to “more effective interaction”.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on16
- iTransformer: Inverted Transformers Are Effective for Time Series ForecastingYong Liu, Tengge Hu, Haoran Zhang, Haixu Wu et al.ICLR 2024 · 1,703 citations
- Reversible Instance Normalization for Accurate Time-Series Forecasting against Distribution ShiftTaesung Kim, Jinhee Kim, Yunwon Tae, Cheonbok Park et al.ICLR 2022 · 1,020 citations
- SCINet: Time Series Modeling and Forecasting with Sample Convolution and InteractionMinhao Liu, Ailing Zeng, Muxi Chen, Zhijian Xu et al.NeurIPS 2022 · 934 citations
- A Time Series is Worth 64 Words: Long-term Forecasting with TransformersYuqi Nie, Nam H. Nguyen, Phanwadee Sinthong, Jayant KalagnanamICLR 2023 · 536 citations
- TFB: Towards Comprehensive and Fair Benchmarking of Time Series Forecasting MethodsXiangfei Qiu, Jilin Hu, Lekui Zhou, Xingjian Wu et al.VLDB 2024 · 292 citations
Related papers
- Towards Robust Real-World Multivariate Time Series Forecasting: A Unified Framework for Dependency, Asynchrony, and MissingnessJinkwan Jang, Hyungjin Park, Jinmyeong Choi, Taesup KimICLR 2026 · 2 citations
- LatentFlow: Discovering Latent Continuous Dynamics across Channels for Multivariate Time Series Anomaly DetectionLijun Sun, Shuai Zhang, Xin Xue, Lanhao Li et al.KDD 2026
- Temporal Query Network for Efficient Multivariate Time Series ForecastingShengsheng Lin, Haojun Chen, Haijie Wu, Chunyun Qiu et al.ICML 2025
- Crisp: A Spectral-Based Interaction Strategy for Multivariate Time Series ForecastingBinwu Wang, Gaoyun Lin, Jiaming Ma, Qihe Huang et al.ICML 2026
- Rethinking Channel Dependence for Multivariate Time Series Forecasting: Learning from Leading IndicatorsLifan Zhao, Yanyan ShenICLR 2024 · 50 citations
