Towards Foundation Models for Zero-Shot Time Series Anomaly Detection: Leveraging Synthetic Data and Relative Context Discrepancy
Tian Lan, Hao Le, Jinbo Li, Wenjun He, Meng Wang, Chenghao Liu, Chen Zhang
摘要
Time series anomaly detection(TSAD) is a critical task, but developing models that generalize to unseen data in a zero-shot manner remains challenging. Existing foundation models for TSAD often rely on reconstruction-error scoring at inference time, which can miss subtle anomalies that are well reconstructed and can falsely flag complex but normal patterns in unseen domains. We introduce TimeRCD, a foundation model for TSAD built on Relative Context Discrepancy (RCD), a pre-training paradigm that trains the model to detect anomalies by comparing a query pattern with its surrounding context. This relational formulation, implemented with a standard Transformer architecture, enables the model to infer normality from the input context rather than relying on fixed global normal patterns. We further construct a large-scale synthetic corpus with context-dependent anomaly labels to provide supervised pre-training signals for RCD. Experiments across diverse benchmarks show that TimeRCD outperforms existing general-purpose and anomaly-specific foundation models in most zero-shot TSAD settings, while remaining competitive with dataset-specific full-shot baselines. These results provide empirical evidence that RCD is an effective direction for building robust and generalizable TSAD models.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper3
- CauKer: Classification Time Series Foundation Models Can Be Pretrained on Synthetic DataShifeng Xie, Vasilii Feofanov, Jianfeng Zhang, Themis Palpanas 等ICLR 2026 · 被引用 15 次
- From Zero to Hero: Advancing Zero-Shot Foundation Models for Tabular Outlier DetectionXueying Ding, Haomin Wen, Simon Klüttermann, Leman AkogluICML 2026 · 被引用 5 次
- TimeRadar: A Domain-Rotatable Foundation Model for Time Series Anomaly DetectionHui He, Hezhe Qiao, Yutong Chen, Kun Yi 等KDD 2026
它引用的顶会 Paper16
- Anomaly Transformer: Time Series Anomaly Detection with Association DiscrepancyJiehui Xu, Haixu Wu, Jianmin Wang, Mingsheng LongICLR 2022 · 被引用 960 次
- TranAD: Deep Transformer Networks for Anomaly Detection in Multivariate Time Series DataShreshth Tuli, Giuliano Casale, Nicholas R. JenningsVLDB 2022 · 被引用 930 次
- A decoder-only foundation model for time-series forecastingAbhimanyu Das, Weihao Kong, Rajat Sen, Yichen ZhouICML 2024 · 被引用 601 次
- Unified Training of Universal Time Series Forecasting TransformersGerald Woo, Chenghao Liu, Akshat Kumar, Caiming Xiong 等ICML 2024 · 被引用 513 次
- Timeseries Anomaly Detection using Temporal Hierarchical One-Class NetworkLifeng Shen, Zhuocong Li, James T. KwokNeurIPS 2020 · 被引用 454 次
相关 Paper
- When Foundation Models are One-Liners: Limitations and Future Directions for Time Series Anomaly DetectionXiaokun Zhu, Louis Carpentier, Mathias VerbekeICLR 2026
- Towards a General Time Series Anomaly Detector with Adaptive Bottlenecks and Dual Adversarial DecodersQichao Shentu, Beibu Li, Kai Zhao, Yang Shu 等ICLR 2025
- Nominality Score Conditioned Time Series Anomaly Detection by Point/Sequential ReconstructionChih-Yu Lai, Fan-Keng Sun, Zhengqi Gao, Jeffrey H. Lang 等NeurIPS 2023 · 被引用 61 次
- Harnessing Vision-Language Models for Time Series Anomaly DetectionZelin He, Sarah Alnegheimish, Matthew ReimherrAAAI 2026 · 被引用 10 次
- In-Context Fine-Tuning for Time-Series Foundation ModelsMatthew Faw, Rajat Sen, Yichen Zhou, Abhimanyu DasICML 2025
