LAST SToP for Modeling Asynchronous Time Series
Shubham Gupta, Thibaut Durand, Graham W. Taylor, Lilian W. Bialokozowicz
Abstract
We present a novel prompt design for Large Language Models (LLMs) tailored to Asynchronous Time Series. Unlike regular time series, which assume values at evenly spaced time points, asynchronous time series consist of timestamped events occurring at irregular intervals, each described in natural language. Our approach effectively utilizes the rich natural language of event descriptions, allowing LLMs to benefit from their broad world knowledge for reasoning across different domains and tasks. This allows us to extend the scope of asynchronous time series analysis beyond forecasting to include tasks like anomaly detection and data imputation. We further introduce Stochastic Soft Prompting, a novel prompt-tuning mechanism that significantly improves model performance, outperforming existing fine-tuning methods such as QLoRA. Through extensive experiments on realworld datasets, we demonstrate that our approach achieves state-of-the-art performance across different tasks and datasets.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a8e5f197-91a2-4afe-954a-4b17a0d14885Builds on31
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Informer: Beyond Efficient Transformer for Long Sequence Time-Series ForecastingHaoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang et al.AAAI 2021 · 7,289 citations
- Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series ForecastingHaixu Wu, Jiehui Xu, Jianmin Wang, Mingsheng LongNeurIPS 2021 · 5,824 citations
- BEiT: BERT Pre-Training of Image TransformersHangbo Bao, Li Dong, Songhao Piao, Furu WeiICLR 2022 · 3,632 citations
Related papers
- TEST: Text Prototype Aligned Embedding to Activate LLM's Ability for Time SeriesChenxi Sun, Hongyan Li, Yaliang Li, Shenda HongICLR 2024 · 223 citations
- Delving into Large Language Models for Effective Time-Series Anomaly DetectionJunwoo Park, Kyudan Jung, Dohyun Lee, Hyuck Lee et al.NeurIPS 2025 · 1 citation
- TsLLM: Augmenting LLMs for General Time Series Understanding and PredictionFelix Parker, Nimeesha Chan, Chi Zhang, Kimia GhobadiICML 2026 · 3 citations
- AutoTimes: Autoregressive Time Series Forecasters via Large Language ModelsYong Liu, Guo Qin, Xiangdong Huang, Jianmin Wang et al.NeurIPS 2024 · 138 citations
- Hi-Time: Hierarchical Latent Prediction for Multivariate Time Series ClassificationKun Zeng, Wu Binquan, Qianli MaICML 2026
