Feature Programming for Multivariate Time Series Prediction
Alex Daniel Reneau, Jerry Yao-Chieh Hu, Ammar Gilani, Han Liu
Abstract
We introduce the concept of programmable feature engineering for time series modeling and propose a feature programming framework. This framework generates large amounts of predictive features for noisy multivariate time series while allowing users to incorporate their inductive bias with minimal effort. The key motivation of our framework is to view any multivariate time series as a cumulative sum of fine-grained trajectory increments, with each increment governed by a novel spin-gas dynamical Ising model. This finegrained perspective motivates the development of a parsimonious set of operators that summarize multivariate time series in an abstract fashion, serving as the foundation for large-scale automated feature engineering. Numerically, we validate the efficacy of our method on several synthetic and real-world noisy time series datasets. Code is available at github.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e81df9c7-2e11-4800-8794-52457f42f69dCited by top-tier papers6
- Outlier-Efficient Hopfield Layers for Large Transformer-Based ModelsJerry Yao-Chieh Hu, Pei-Hsuan Chang, Haozheng Luo, Hong-Yu Chen et al.ICML 2024 · 46 citations
- Uniform Memory Retrieval with Larger Capacity for Modern Hopfield ModelsDennis Wu, Jerry Yao-Chieh Hu, Teng-Yun Hsiao, Han LiuICML 2024 · 44 citations
- STanHop: Sparse Tandem Hopfield Model for Memory-Enhanced Time Series PredictionDennis Wu, Jerry Yao-Chieh Hu, Weijian Li, Bo-Yu Chen et al.ICLR 2024 · 39 citations
- Unraveling the Smoothness Properties of Diffusion Models: A Gaussian Mixture PerspectiveYingyu Liang, Zhizhou Sha, Zhenmei Shi, Zhao Song et al.ICCV 2025 · 23 citations
- Latent Variable Estimation in Bayesian Black-Litterman ModelsThomas Yuan-Lung Lin, Jerry Yao-Chieh Hu, Paul W. Chiou, Peter LinICML 2025
Builds on1
Related papers
- Dynamic Gaussian Mixture based Deep Generative Model For Robust Forecasting on Sparse Multivariate Time SeriesYinjun Wu, Jingchao Ni, Wei Cheng, Bo Zong et al.AAAI 2021 · 76 citations
- Hi-Time: Hierarchical Latent Prediction for Multivariate Time Series ClassificationKun Zeng, Wu Binquan, Qianli MaICML 2026
- TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series ForecastingDefu Cao, Furong Jia, Sercan Ö. Arik, Tomas Pfister et al.ICLR 2024 · 262 citations
- Latent Diffusion Transformer for Probabilistic Time Series ForecastingShibo Feng, Chunyan Miao, Zhong Zhang, Peilin ZhaoAAAI 2024 · 60 citations
- The Semantic Architect: How FEAML Bridges Structured Data and LLMs for Multi-Label TasksWanfu Gao, Zebin He, Jun GaoAAAI 2026
