Utilizing Expert Features for Contrastive Learning of Time-Series Representations
Manuel T. Nonnenmacher, Lukas Oldenburg, Ingo Steinwart, David Reeb
摘要
We present an approach that incorporates expert knowledge for time-series representation learning. Our method employs expert features to replace the commonly used data transformations in previous contrastive learning approaches. We do this since time-series data frequently stems from the industrial or medical field where expert features are often available from domain experts, while transformations are generally elusive for time-series data. We start by proposing two properties that useful time-series representations should fulfill and show that current representation learning approaches do not ensure these properties. We therefore devise ExpCLR, a novel contrastive learning approach built on an objective that utilizes expert features to encourage both properties for the learned representation. Finally, we demonstrate on three real-world time-series datasets that ExpCLR surpasses several state-of-the-art methods for both unsupervised and semi-supervised representation learning.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper10
- SimMTM: A Simple Pre-Training Framework for Masked Time-Series ModelingJiaxiang Dong, Haixu Wu, Haoran Zhang, Li Zhang 等NeurIPS 2023 · 被引用 225 次
- Contrast Everything: A Hierarchical Contrastive Framework for Medical Time-SeriesYihe Wang, Yu Han, Haishuai Wang, Xiang ZhangNeurIPS 2023 · 被引用 106 次
- FOCAL: Contrastive Learning for Multimodal Time-Series Sensing Signals in Factorized Orthogonal Latent SpaceShengzhong Liu, Tomoyoshi Kimura, Dongxin Liu, Ruijie Wang 等NeurIPS 2023 · 被引用 72 次
- Parametric Augmentation for Time Series Contrastive LearningXu Zheng, Tianchun Wang, Wei Cheng, Aitian Ma 等ICLR 2024 · 被引用 29 次
- Supervised Contrastive Few-Shot Learning for High-Frequency Time SeriesXi Chen, Cheng Ge, Ming Wang, Jin WangAAAI 2023 · 被引用 15 次
它引用的顶会 Paper12
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 被引用 24,064 次
- Bootstrap Your Own Latent - A New Approach to Self-Supervised LearningJean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec 等NeurIPS 2020 · 被引用 9,171 次
- Supervised Contrastive LearningPrannay Khosla, Piotr Teterwak, Chen Wang, Aaron Sarna 等NeurIPS 2020 · 被引用 7,049 次
- Understanding Contrastive Representation Learning through Alignment and Uniformity on the HypersphereTongzhou Wang, Phillip IsolaICML 2020 · 被引用 2,360 次
- Debiased Contrastive LearningChing-Yao Chuang, Joshua Robinson, Yen-Chen Lin, Antonio Torralba 等NeurIPS 2020 · 被引用 761 次
相关 Paper
- FreRA: A Frequency-Refined Augmentation for Contrastive Learning on Time Series ClassificationTian Tian, Chunyan Miao, Hangwei QianKDD 2025 · 被引用 4 次
- TimesURL: Self-Supervised Contrastive Learning for Universal Time Series Representation LearningJiexi Liu, Songcan ChenAAAI 2024 · 被引用 128 次
- Soft Contrastive Learning for Time SeriesSeunghan Lee, Taeyoung Park, Kibok LeeICLR 2024 · 被引用 63 次
- TimeDRL: Disentangled Representation Learning for Multivariate Time-SeriesChing Chang, Chiao-Tung Chan, Wei-Yao Wang, Wen-Chih Peng 等ICDE 2024 · 被引用 21 次
- Temporal-Frequency Co-training for Time Series Semi-supervised LearningZhen Liu, Qianli Ma, Peitian Ma, Linghao WangAAAI 2023 · 被引用 39 次
