SKOLR: Structured Koopman Operator Linear RNN for Time-Series Forecasting
Yitian Zhang, Liheng Ma, Antonios Valkanas, Boris N. Oreshkin, Mark Coates
摘要
Koopman operator theory provides a framework for nonlinear dynamical system analysis and timeseries forecasting by mapping dynamics to a space of real-valued measurement functions, enabling a linear operator representation. Despite the advantage of linearity, the operator is generally infinite-dimensional. Therefore, the objective is to learn measurement functions that yield a tractable finite-dimensional Koopman operator approximation. In this work, we establish a connection between Koopman operator approximation and linear Recurrent Neural Networks (RNNs), which have recently demonstrated remarkable success in sequence modeling. We show that by considering an extended state consisting of lagged observations, we can establish an equivalence between a structured Koopman operator and linear RNN updates. Building on this connection, we present SKOLR, which integrates a learnable spectral decomposition of the input signal with a multilayer perceptron (MLP) as the measurement functions and implements a structured Koopman operator via a highly parallel linear RNN stack. Numerical experiments on various forecasting benchmarks and dynamical systems show that this streamlined, Koopman-theorybased design delivers exceptional performance.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它它引用的顶会 Paper16
- Informer: Beyond Efficient Transformer for Long Sequence Time-Series ForecastingHaoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang 等AAAI 2021 · 被引用 7,289 次
- Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series ForecastingHaixu Wu, Jiehui Xu, Jianmin Wang, Mingsheng LongNeurIPS 2021 · 被引用 5,824 次
- Are Transformers Effective for Time Series Forecasting?Ailing Zeng, Muxi Chen, Lei Zhang, Qiang XuAAAI 2023 · 被引用 3,619 次
- iTransformer: Inverted Transformers Are Effective for Time Series ForecastingYong Liu, Tengge Hu, Haoran Zhang, Haixu Wu 等ICLR 2024 · 被引用 1,703 次
- Reversible Instance Normalization for Accurate Time-Series Forecasting against Distribution ShiftTaesung Kim, Jinhee Kim, Yunwon Tae, Cheonbok Park 等ICLR 2022 · 被引用 1,020 次
相关 Paper
- ResKoopNet: Learning Koopman Representations for Complex Dynamics with Spectral ResidualsYuanchao Xu, Kaidi Shao, Nikos K. Logothetis, Zhongwei ShenICML 2025
- Koopman Neural Operator Forecaster for Time-series with Temporal Distributional ShiftsRui Wang, Yihe Dong, Sercan Ö. Arik, Rose YuICLR 2023 · 被引用 6 次
- Forecasting Sequential Data Using Consistent Koopman AutoencodersOmri Azencot, N. Benjamin Erichson, Vanessa Lin, Michael W. MahoneyICML 2020 · 被引用 203 次
- Koopa: Learning Non-stationary Time Series Dynamics with Koopman PredictorsYong Liu, Chenyu Li, Jianmin Wang, Mingsheng LongNeurIPS 2023 · 被引用 284 次
- Koopman Kernel RegressionPetar Bevanda, Max Beier, Armin Lederer, Stefan Sosnowski 等NeurIPS 2023 · 被引用 36 次
