An Unsupervised Approach for Periodic Source Detection in Time Series
Berken Utku Demirel, Christian Holz
Abstract
Detection of periodic patterns of interest within noisy time series data plays a critical role in various tasks, spanning from health monitoring to behavior analysis. Existing learning techniques often rely on labels or clean versions of signals for detecting the periodicity, and those employing self-supervised learning methods are required to apply proper augmentations, which is already challenging for time series and can result in collapse -- all representations collapse to a single point due to strong augmentations. In this work, we propose a novel method to detect the periodicity in time series without the need for any labels or requiring tailored positive or negative data generation mechanisms with specific augmentations. We mitigate the collapse issue by ensuring the learned representations retain information from the original samples without imposing any random variance constraints on the batch. Our experiments in three time series tasks against state-of-the-art learning methods show that the proposed approach consistently outperforms prior works, achieving performance improvements of more than 45--50%, showing its effectiveness. Code: https://github.com/eth-siplab/Unsupervised_Periodicity_Detection
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext cab585da-3436-4c3a-bca2-80ec8cfbb411Cited by top-tier papers1
Ask how each one uses itBuilds on19
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Bootstrap Your Own Latent - A New Approach to Self-Supervised LearningJean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec et al.NeurIPS 2020 · 9,171 citations
- Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series ForecastingHaixu Wu, Jiehui Xu, Jianmin Wang, Mingsheng LongNeurIPS 2021 · 5,824 citations
- Barlow Twins: Self-Supervised Learning via Redundancy ReductionJure Zbontar, Li Jing, Ishan Misra, Yann LeCun et al.ICML 2021 · 2,942 citations
- What Makes for Good Views for Contrastive Learning?Yonglong Tian, Chen Sun, Ben Poole, Dilip Krishnan et al.NeurIPS 2020 · 1,631 citations
Related papers
- T-Rep: Representation Learning for Time Series using Time-EmbeddingsArchibald Fraikin, Adrien Bennetot, Stéphanie AllassonnièreICLR 2024 · 24 citations
- SimPer: Simple Self-Supervised Learning of Periodic TargetsYuzhe Yang, Xin Liu, Jiang Wu, Silviu Borac et al.ICLR 2023 · 20 citations
- Finding Order in Chaos: A Novel Data Augmentation Method for Time Series in Contrastive LearningBerken Utku Demirel, Christian HolzNeurIPS 2023 · 48 citations
- When Model Meets New Normals: Test-Time Adaptation for Unsupervised Time-Series Anomaly DetectionDongmin Kim, Sunghyun Park, Jaegul ChooAAAI 2024 · 43 citations
- AmortizedPeriod: Attention-based Amortized Inference for Periodicity IdentificationHang Yu, Cong Liao, Ruolan Liu, Jianguo Li et al.ICLR 2024 · 2 citations
