Towards Foundation Models for Zero-Shot Time Series Anomaly Detection: Leveraging Synthetic Data and Relative Context Discrepancy
Tian Lan, Hao Le, Jinbo Li, Wenjun He, Meng Wang, Chenghao Liu, Chen Zhang
Abstract
Time series anomaly detection(TSAD) is a critical task, but developing models that generalize to unseen data in a zero-shot manner remains challenging. Existing foundation models for TSAD often rely on reconstruction-error scoring at inference time, which can miss subtle anomalies that are well reconstructed and can falsely flag complex but normal patterns in unseen domains. We introduce TimeRCD, a foundation model for TSAD built on Relative Context Discrepancy (RCD), a pre-training paradigm that trains the model to detect anomalies by comparing a query pattern with its surrounding context. This relational formulation, implemented with a standard Transformer architecture, enables the model to infer normality from the input context rather than relying on fixed global normal patterns. We further construct a large-scale synthetic corpus with context-dependent anomaly labels to provide supervised pre-training signals for RCD. Experiments across diverse benchmarks show that TimeRCD outperforms existing general-purpose and anomaly-specific foundation models in most zero-shot TSAD settings, while remaining competitive with dataset-specific full-shot baselines. These results provide empirical evidence that RCD is an effective direction for building robust and generalizable TSAD models.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 20a6fe40-e95b-419b-a58d-f50e6411feb5Cited by top-tier papers3
- CauKer: Classification Time Series Foundation Models Can Be Pretrained on Synthetic DataShifeng Xie, Vasilii Feofanov, Jianfeng Zhang, Themis Palpanas et al.ICLR 2026 · 15 citations
- From Zero to Hero: Advancing Zero-Shot Foundation Models for Tabular Outlier DetectionXueying Ding, Haomin Wen, Simon Klüttermann, Leman AkogluICML 2026 · 5 citations
- TimeRadar: A Domain-Rotatable Foundation Model for Time Series Anomaly DetectionHui He, Hezhe Qiao, Yutong Chen, Kun Yi et al.KDD 2026
Builds on16
- Anomaly Transformer: Time Series Anomaly Detection with Association DiscrepancyJiehui Xu, Haixu Wu, Jianmin Wang, Mingsheng LongICLR 2022 · 960 citations
- TranAD: Deep Transformer Networks for Anomaly Detection in Multivariate Time Series DataShreshth Tuli, Giuliano Casale, Nicholas R. JenningsVLDB 2022 · 930 citations
- A decoder-only foundation model for time-series forecastingAbhimanyu Das, Weihao Kong, Rajat Sen, Yichen ZhouICML 2024 · 601 citations
- Unified Training of Universal Time Series Forecasting TransformersGerald Woo, Chenghao Liu, Akshat Kumar, Caiming Xiong et al.ICML 2024 · 513 citations
- Timeseries Anomaly Detection using Temporal Hierarchical One-Class NetworkLifeng Shen, Zhuocong Li, James T. KwokNeurIPS 2020 · 454 citations
Related papers
- When Foundation Models are One-Liners: Limitations and Future Directions for Time Series Anomaly DetectionXiaokun Zhu, Louis Carpentier, Mathias VerbekeICLR 2026
- Towards a General Time Series Anomaly Detector with Adaptive Bottlenecks and Dual Adversarial DecodersQichao Shentu, Beibu Li, Kai Zhao, Yang Shu et al.ICLR 2025
- Nominality Score Conditioned Time Series Anomaly Detection by Point/Sequential ReconstructionChih-Yu Lai, Fan-Keng Sun, Zhengqi Gao, Jeffrey H. Lang et al.NeurIPS 2023 · 61 citations
- Harnessing Vision-Language Models for Time Series Anomaly DetectionZelin He, Sarah Alnegheimish, Matthew ReimherrAAAI 2026 · 10 citations
- In-Context Fine-Tuning for Time-Series Foundation ModelsMatthew Faw, Rajat Sen, Yichen Zhou, Abhimanyu DasICML 2025
