Time Series Change Point Detection with Self-Supervised Contrastive Predictive Coding
Shohreh Deldari, Daniel V. Smith, Hao Xue, Flora D. Salim
Abstract
Change Point Detection (CPD) methods identify the times associated with changes in the trends and properties of time series data in order to describe the underlying behaviour of the system. For instance, detecting the changes and anomalies associated with web service usage, application usage or human behaviour can provide valuable insights for downstream modelling tasks. We propose a novel approach for self-supervised Time Series Change Point detection method based on Contrastive Predictive coding (𝑇 𝑆 -𝐶𝑃 2 ). 𝑇 𝑆 -𝐶𝑃 2 is the first approach to employ a contrastive learning strategy for CPD by learning an embedded representation that separates pairs of embeddings of time adjacent intervals from pairs of interval embeddings separated across time. Through extensive experiments on three diverse, widely used time series datasets, we demonstrate that our method outperforms five state-of-the-art CPD methods, which include unsupervised and semi-supervised approaches. 𝑇 𝑆 -𝐶𝑃 2 is shown to improve the performance of methods that use either handcrafted statistical or temporal features by 79.4% and deep learning-based methods by 17.0% with respect to the F1-score averaged across the three datasets.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 2b0765b0-c106-4325-9628-d66ff27cfc01Cited by top-tier papers19
- Anomaly Transformer: Time Series Anomaly Detection with Association DiscrepancyJiehui Xu, Haixu Wu, Jianmin Wang, Mingsheng LongICLR 2022 · 960 citations
- DCdetector: Dual Attention Contrastive Representation Learning for Time Series Anomaly DetectionYiyuan Yang, Chaoli Zhang, Tian Zhou, Qingsong Wen et al.KDD 2023 · 244 citations
- Adaptive Normalization for Non-stationary Time Series Forecasting: A Temporal Slice PerspectiveZhiding Liu, Mingyue Cheng, Zhi Li, Zhenya Huang et al.NeurIPS 2023 · 162 citations
- ColloSSL: Collaborative Self-Supervised Learning for Human Activity RecognitionYash Jain, Chi Ian Tang, Chulhong Min, Fahim Kawsar et al.UbiComp 2022 · 113 citations
- Assessing the State of Self-Supervised Human Activity Recognition Using WearablesHarish Haresamudram, Irfan Essa, Thomas PlötzUbiComp 2022 · 104 citations
Builds on4
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Data-Efficient Image Recognition with Contrastive Predictive CodingOlivier J. HénaffICML 2020 · 1,553 citations
- ESPRESSO: Entropy and ShaPe awaRe timE-Series SegmentatiOn for Processing Heterogeneous Sensor DataShohreh Deldari, Daniel V. Smith, Amin Sadri, Flora D. SalimUbiComp 2020 · 46 citations
- Robust Unsupervised Factory Activity Recognition with Body-worn Accelerometer Using Temporal Structure of Multiple Sensor Data MotifsQingxin Xia, Joseph Korpela, Yasuo Namioka, Takuya MaekawaUbiComp 2020 · 42 citations
Related papers
- Semi-supervised Sequence Classification through Change Point DetectionNauman Ahad, Mark A. DavenportAAAI 2021 · 8 citations
- TS2Vec: Towards Universal Representation of Time SeriesZhihan Yue, Yujing Wang, Juanyong Duan, Tianmeng Yang et al.AAAI 2022 · 938 citations
- Soft Contrastive Learning for Time SeriesSeunghan Lee, Taeyoung Park, Kibok LeeICLR 2024 · 63 citations
- TimesURL: Self-Supervised Contrastive Learning for Universal Time Series Representation LearningJiexi Liu, Songcan ChenAAAI 2024 · 128 citations
- T-Rep: Representation Learning for Time Series using Time-EmbeddingsArchibald Fraikin, Adrien Bennetot, Stéphanie AllassonnièreICLR 2024 · 24 citations
