FlowMixer: A Depth-Agnostic Neural Architecture for Interpretable Spatiotemporal Forecasting
Fares B. Mehouachi, Saif Eddin Jabari
Abstract
We introduce FlowMixer, a single-layer neural architecture that leverages constrained matrix operations to model structured spatiotemporal patterns with enhanced interpretability. FlowMixer incorporates non-negative matrix mixing layers within a reversible mapping framework - applying transforms before mixing and their inverses afterward. This shape-preserving design enables a Kronecker-Koopman eigenmodes framework that bridges statistical learning with dynamical systems theory, providing interpretable spatiotemporal patterns and facilitating direct algebraic manipulation of prediction horizons without retraining. The architecture's semi-group property enables this single layer to mathematically represent any depth through composition, eliminating depth search entirely. Extensive experiments across diverse domains demonstrate FlowMixer's long-horizon forecasting capabilities while effectively modeling physical phenomena such as chaotic attractors and turbulent flows. Our results achieve performance matching state-of-the-art methods while offering superior interpretability through directly extractable eigenmodes. This work suggests that architectural constraints can simultaneously maintain competitive performance and enhance mathematical interpretability in neural forecasting systems.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on16
- Informer: Beyond Efficient Transformer for Long Sequence Time-Series ForecastingHaoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang et al.AAAI 2021 · 7,289 citations
- Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series ForecastingHaixu Wu, Jiehui Xu, Jianmin Wang, Mingsheng LongNeurIPS 2021 · 5,824 citations
- Are Transformers Effective for Time Series Forecasting?Ailing Zeng, Muxi Chen, Lei Zhang, Qiang XuAAAI 2023 · 3,619 citations
- FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series ForecastingTian Zhou, Ziqing Ma, Qingsong Wen, Xue Wang et al.ICML 2022 · 2,912 citations
- N-BEATS: Neural basis expansion analysis for interpretable time series forecastingBoris N. Oreshkin, Dmitri Carpov, Nicolas Chapados, Yoshua BengioICLR 2020 · 1,550 citations
Related papers
- Transform Once: Efficient Operator Learning in Frequency DomainMichael Poli, Stefano Massaroli, Federico Berto, Jinkyoo Park et al.NeurIPS 2022 · 29 citations
- Chaos Meets Attention: Transformers for Large-Scale Dynamical PredictionYi He, Yiming Yang, Xiaoyuan Cheng, Hai Wang et al.ICML 2025
- Course Correcting Koopman RepresentationsMahan Fathi, Clement Gehring, Jonathan Pilault, David Kanaa et al.ICLR 2024 · 1 citation
- HyperMixer: Specializable Hypergraph Channel Mixing for Long-term Multivariate Time Series ForecastingChangyuan Tian, Zhicong Lu, Zequn Zhang, Heming Yang et al.AAAI 2025 · 5 citations
- Differential-Integral Neural Operator for Long-Term Turbulence ForecastingHao Wu, Yuan Gao, Fan Xu, Fan Zhang et al.KDD 2026 · 6 citations
