AdaTS: Learning Adaptive Time Series Representations via Dynamic Soft Contrasts
Denizhan Kara, Tomoyoshi Kimura, Jinyang Li, Bowen He, Yizhuo Chen, Yigong Hu, Hongjue Zhao, Shengzhong Liu, Tarek F. Abdelzaher
Abstract
Learning robust representations from unlabeled time series is crucial, and contrastive learning offers a promising avenue. However, existing contrastive learning approaches for time series often struggle to define meaningful similarities, tending to overlook inherent physical correlations and diverse, sequence-varying non-stationarity. This limits their representational quality and real-world adaptability. To address these limitations, we introduce AdaTS, a novel adaptive soft contrastive learning strategy. AdaTS offers a computationally efficient solution centered on dynamic instance-wise and temporal assignments that enhance time series representations by: (i) leveraging Time-Frequency Coherence to provide robust, physics-guided similarity measurements; (ii) preserving relative instance similarities through ordinal consistency learning; and (iii) adapting to sequencespecific non-stationarity with dynamic temporal assignments. AdaTS is designed as a pluggable module for standard contrastive frameworks, achieving accuracy improvements of up to 13.7% across diverse time series datasets and three state-ofthe-art contrastive frameworks while enhancing robustness under label scarcity.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on31
- Swin Transformer: Hierarchical Vision Transformer using Shifted WindowsZe Liu, Yutong Lin, Yue Cao, Han Hu et al.ICCV 2021 · 31,683 citations
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Bootstrap Your Own Latent - A New Approach to Self-Supervised LearningJean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec et al.NeurIPS 2020 · 9,171 citations
- Emerging Properties in Self-Supervised Vision TransformersMathilde Caron, Hugo Touvron, Ishan Misra, Hervé Jégou et al.ICCV 2021 · 8,921 citations
- Informer: Beyond Efficient Transformer for Long Sequence Time-Series ForecastingHaoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang et al.AAAI 2021 · 7,289 citations
Related papers
- Soft Contrastive Learning for Time SeriesSeunghan Lee, Taeyoung Park, Kibok LeeICLR 2024 · 63 citations
- Multi-view Self-Supervised Contrastive Learning for Multivariate Time SeriesYuhan Wu, Xiyu Meng, Yang He, Junru Zhang et al.ACM MM 2024 · 5 citations
- Augmented Contrastive Clustering with Uncertainty-Aware Prototyping for Time Series Test Time AdaptationPeiliang Gong, Mohamed Ragab, Min Wu, Zhenghua Chen et al.KDD 2025 · 1 citation
- FreRA: A Frequency-Refined Augmentation for Contrastive Learning on Time Series ClassificationTian Tian, Chunyan Miao, Hangwei QianKDD 2025 · 4 citations
- Parametric Augmentation for Time Series Contrastive LearningXu Zheng, Tianchun Wang, Wei Cheng, Aitian Ma et al.ICLR 2024 · 29 citations
