FSTLLM: Spatio-Temporal LLM for Few Shot Time Series Forecasting
Yue Jiang, Yile Chen, Xiucheng Li, Qin Chao, Shuai Liu, Gao Cong
Abstract
Time series forecasting fundamentally relies on accurately modeling complex interdependencies and shared patterns within time series data. Recent advancements, such as Spatio-Temporal Graph Neural Networks (STGNNs) and Time Series Foundation Models (TSFMs), have demonstrated promising results by effectively capturing intricate spatial and temporal dependencies across diverse real-world datasets. However, these models typically require large volumes of training data and often struggle in data-scarce scenarios. To address this limitation, we propose a framework named Few-shot Spatio-Temporal Large Language Models (FSTLLM), aimed at enhancing model robustness and predictive performance in few-shot settings. FSTLLM leverages the contextual knowledge embedded in Large Language Models (LLMs) to provide reasonable and accurate predictions. In addition, it supports the seamless integration of existing forecasting models to further boost their predicative capabilities. Experimental results on real-world datasets demonstrate the adaptability and consistently superior performance of FSTLLM over major baseline models by a significant margin. Our code is available at: https://github.com/ JIANGYUE61610306/FSTLLM .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7c4537bb-b874-4f53-a132-648525d6d33dCited by top-tier papers5
- ARROW: An Adaptive Rollout and Routing Method for Global Weather ForecastingJindong Tian, Yifei Ding, Ronghui Xu, Hao Miao et al.ICLR 2026 · 14 citations
- LoFT-LLM: Low-Frequency Time-series Forecasting with Large Language ModelsJiacheng You, Jingcheng Yang, Yuhang Xie, Zhongxuan Wu et al.KDD 2026 · 2 citations
- Words Towards Explainability: Caption Label-Free Learning via Dual Loop Agentic Time Series CaptioningDifei Hou, Jiaqi Yue, Chunhui ZhaoICML 2026
- LagLLM: LLM-empowered lead–lag dependency learning for spatial-temporal time series forecastingBinqing Wu, Jian Zhou, Zongjiang Shang, Ling ChenICML 2026
- CoGenCast: A Coupled Autoregressive–Flow Generative Framework for Time Series ForecastingMingyue Cheng, Yaguo Liu, Daoyu Wang, Xiaoyu Tao et al.ICML 2026
Builds on30
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- Large Language Models are Zero-Shot ReasonersTakeshi Kojima, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo et al.NeurIPS 2022 · 8,168 citations
- Informer: Beyond Efficient Transformer for Long Sequence Time-Series ForecastingHaoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang et al.AAAI 2021 · 7,289 citations
- Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series ForecastingHaixu Wu, Jiehui Xu, Jianmin Wang, Mingsheng LongNeurIPS 2021 · 5,824 citations
- FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series ForecastingTian Zhou, Ziqing Ma, Qingsong Wen, Xue Wang et al.ICML 2022 · 2,912 citations
Related papers
- Time-FFM: Towards LM-Empowered Federated Foundation Model for Time Series ForecastingQingxiang Liu, Xu Liu, Chenghao Liu, Qingsong Wen et al.NeurIPS 2024 · 43 citations
- ST-VLM: A Spatial-to-Image Multimodal Spatial-Temporal Prediction Framework with Vision-Language ModelTong Zhao, Junping Du, Zhe Xue, Meiyu Liang et al.AAAI 2026
- Time-LLM: Time Series Forecasting by Reprogramming Large Language ModelsMing Jin, Shiyu Wang, Lintao Ma, Zhixuan Chu et al.ICLR 2024 · 915 citations
- STEM-LTS: Integrating Semantic-Temporal Dynamics in LLM-driven Time Series AnalysisZhe Zhao, Pengkun Wang, Haibin Wen, Shuang Wang et al.AAAI 2025 · 7 citations
- From Tokenizer Bias to Backbone Capability: A Controlled Study of LLMs for Time Series ForecastingXinyu Zhang, Shanshan Feng, Xutao Li, Kenghong Lin et al.KDD 2026 · 2 citations
