Shifting Time: Time-series Forecasting with Khatri-Rao Neural Operators
Srinath Dama, Kevin Course, Prasanth B. Nair
Abstract
We present an operator-theoretic framework for temporal and spatio-temporal forecasting based on learning a continuous time-shift operator. Our operator learning paradigm offers a continuous relaxation of the discrete lag factor used in traditional autoregressive models, enabling the history of a system up to a given time to be mapped to its future values. We parametrize the time-shift operator using Khatri-Rao neural operators (KRNOs), a novel architecture based on non-stationary integral transforms with nearly linear computational scaling. Our framework naturally handles irregularly sampled observations and enables forecasting at super-resolution in both space and time. Extensive numerical studies across diverse temporal and spatio-temporal benchmarks demonstrate that our approach achieves state-of-the-art or competitive performance with leading methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f16619eb-498a-4c54-875e-64fe7de504b6Cited by top-tier papers1
Ask how each one uses itBuilds on25
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- Fourier Neural Operator for Parametric Partial Differential EquationsZongyi Li, Nikola Borislavov Kovachki, Kamyar Azizzadenesheli, Burigede Liu et al.ICLR 2021 · 3,911 citations
- iTransformer: Inverted Transformers Are Effective for Time Series ForecastingYong Liu, Tengge Hu, Haoran Zhang, Haixu Wu et al.ICLR 2024 · 1,703 citations
- N-BEATS: Neural basis expansion analysis for interpretable time series forecastingBoris N. Oreshkin, Dmitri Carpov, Nicolas Chapados, Yoshua BengioICLR 2020 · 1,550 citations
- Non-stationary Transformers: Exploring the Stationarity in Time Series ForecastingYong Liu, Haixu Wu, Jianmin Wang, Mingsheng LongNeurIPS 2022 · 1,080 citations
Related papers
- Super-Resolution Neural OperatorMin Wei, Xuesong ZhangCVPR 2023
- Spherical Fourier Neural Operators: Learning Stable Dynamics on the SphereBoris Bonev, Thorsten Kurth, Christian Hundt, Jaideep Pathak et al.ICML 2023 · 280 citations
- Koopman Neural Operator Forecaster for Time-series with Temporal Distributional ShiftsRui Wang, Yihe Dong, Sercan Ö. Arik, Rose YuICLR 2023 · 6 citations
- Learning semilinear neural operators: A unified recursive framework for prediction and data assimilationAshutosh Singh, Ricardo Augusto Borsoi, Deniz Erdogmus, Tales ImbiribaICLR 2024 · 5 citations
- Continuous Temporal Domain GeneralizationZekun Cai, Guangji Bai, Renhe Jiang, Xuan Song et al.NeurIPS 2024 · 21 citations
