Divide and Contrast: Learning Robust Temporal Features without Augmentation
Abdul-Kazeem Shamba, Kerstin Bach, Gavin Taylor
摘要
Self-supervised learning for time-series representation aims to reduce reliance on labeled data while maintaining strong downstream performance, yet many existing approaches incur high computational costs or rely on assumptions that do not hold across diverse temporal dynamics. In this work, we introduce Divide and Contrast (Di-COT), an unsupervised framework that avoids data augmentation and multiple encoder passes by contrasting informative substructures within a window rather than individual timesteps. Di-COT stochastically partitions each window into a small number of overlapping sub-blocks per iteration, enabling efficient and meaningful contrast while mitigating false positives during temporal transitions. To further improve scalability, we adopt a contrastive objective whose computation depends on the batch size and the number of sub-blocks, making loss computation independent of sequence length. Extensive experiments on six large-scale real-world datasets, as well as the UCR and UEA benchmarks, demonstrate that Di-COT learns semantically structured and transferable representations, achieving state-of-the-art performance on classification, clustering, kNN, and cross-dataset transfer, while substantially reducing training time. The source code is publicly available at https://github.com/sfi-norwai/Di- COT.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper9
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 被引用 24,064 次
- TS2Vec: Towards Universal Representation of Time SeriesZhihan Yue, Yujing Wang, Juanyong Duan, Tianmeng Yang 等AAAI 2022 · 被引用 938 次
- Self-Supervised Contrastive Pre-Training For Time Series via Time-Frequency ConsistencyXiang Zhang, Ziyuan Zhao, Theodoros Tsiligkaridis, Marinka ZitnikNeurIPS 2022 · 被引用 558 次
- With a Little Help from My Friends: Nearest-Neighbor Contrastive Learning of Visual RepresentationsDebidatta Dwibedi, Yusuf Aytar, Jonathan Tompson, Pierre Sermanet 等ICCV 2021 · 被引用 542 次
- Unsupervised Representation Learning for Time Series with Temporal Neighborhood CodingSana Tonekaboni, Danny Eytan, Anna GoldenbergICLR 2021 · 被引用 386 次
相关 Paper
- Multi-view Self-Supervised Contrastive Learning for Multivariate Time SeriesYuhan Wu, Xiyu Meng, Yang He, Junru Zhang 等ACM MM 2024 · 被引用 5 次
- TimesURL: Self-Supervised Contrastive Learning for Universal Time Series Representation LearningJiexi Liu, Songcan ChenAAAI 2024 · 被引用 128 次
- Sample and Predict Your Latent: Modality-free Sequential Disentanglement via Contrastive EstimationIlan Naiman, Nimrod Berman, Omri AzencotICML 2023 · 被引用 12 次
- FreRA: A Frequency-Refined Augmentation for Contrastive Learning on Time Series ClassificationTian Tian, Chunyan Miao, Hangwei QianKDD 2025 · 被引用 4 次
- Soft Contrastive Learning for Time SeriesSeunghan Lee, Taeyoung Park, Kibok LeeICLR 2024 · 被引用 63 次
