Markovian Linguistic-Temporal Bridge: Unlocking the Potential of LLMs for Time Series Forecasting
Siming Sun, Kai Zhang, Xuejun Jiang, Wenchao Meng, Qinmin Yang
Abstract
Adapting pretrained Large Language Models (LLMs) for time series forecasting primarily relies on token-level linguistic-temporal alignment, leading to the stacking of logically disjointed tokens as input. While empirically effective, these methods overlook a fundamental capability of LLMs: modeling linguistic logic and structure, rather than merely processing token features. To address this limitation, we propose the Markovian-Guided Structure-Aware Alignment (MGSAA). Our core contribution is a framework that transcends pointwise feature matching to achieve global structural isomorphism between the linguistic and temporal domains. Specifically, MGSAA distills latent evolutionary patterns of language within LLMs into a Markovian state transition graph, which is transferred as a structural prior to the time series domain. Under this prior, time series patches are decoded into latent states and then aligned via state-constrained cross-attention. Ultimately, MGSAA generates a token sequence topologically isomorphic to the LLM's inherent mental structure, reactivating its reasoning capabilities for forecasting. Comprehensive evaluations across multiple benchmarks demonstrate that MGSAA achieves state-of-the-art performance, providing an innovative solution for cross-modal alignment in LLM for time series forecasting. Code is available at https: //github.com/sunzju/MGSAA.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 8259ec6d-c35a-4cd0-a526-9298208e32e4Builds on27
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Large Language Models are Zero-Shot ReasonersTakeshi Kojima, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo et al.NeurIPS 2022 · 8,168 citations
- BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and GenerationJunnan Li, Dongxu Li, Caiming Xiong, Steven C. H. HoiICML 2022 · 6,549 citations
- Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series ForecastingHaixu Wu, Jiehui Xu, Jianmin Wang, Mingsheng LongNeurIPS 2021 · 5,824 citations
Related papers
- Semantic-Enhanced Time-Series Forecasting via Large Language ModelsHao Liu, Zhang xiaoxing, Chun Yang, Xiaobin ZhuICLR 2026 · 5 citations
- TimeCMA: Towards LLM-Empowered Multivariate Time Series Forecasting via Cross-Modality AlignmentChenxi Liu, Qianxiong Xu, Hao Miao, Sun Yang et al.AAAI 2025 · 141 citations
- GraFT: Infusing Pre-trained Transformers with Relational Structure for Time Series ForecastingYuqi Yuan, Xiong Luo, Qiaojuan Peng, Wenbing ZhaoAAAI 2026
- Multi-Scale Hypergraph Meets LLMs: Aligning Large Language Models for Time Series AnalysisZongjiang Shang, Dongliang Cui, Binqing Wu, Ling ChenICLR 2026 · 5 citations
- Context-Alignment: Activating and Enhancing LLMs Capabilities in Time SeriesYuxiao Hu, Qian Li, Dongxiao Zhang, Jinyue Yan et al.ICLR 2025 · 1 citation
