Contrast Everything: A Hierarchical Contrastive Framework for Medical Time-Series
Yihe Wang, Yu Han, Haishuai Wang, Xiang Zhang
Abstract
Contrastive representation learning is crucial in medical time series analysis as it alleviates dependency on labor-intensive, domain-specific, and scarce expert annotations. However, existing contrastive learning methods primarily focus on one single data level, which fails to fully exploit the intricate nature of medical time series. To address this issue, we present COMET, an innovative hierarchical framework that leverages data consistencies at all inherent levels in medical time series. Our meticulously designed model systematically captures data consistency from four potential levels: observation, sample, trial, and patient levels. By developing contrastive loss at multiple levels, we can learn effective representations that preserve comprehensive data consistency, maximizing information utilization in a self-supervised manner. We conduct experiments in the challenging patient-independent setting. We compare COMET against six baselines using three diverse datasets, which include ECG signals for myocardial infarction and EEG signals for Alzheimer's and Parkinson's diseases. The results demonstrate that COMET consistently outperforms all baselines, particularly in setup with 10% and 1% labeled data fractions across all datasets. These results underscore the significant impact of our framework in advancing contrastive representation learning techniques for medical time series. The source code is available at https://github.com/DL4mHealth/COMET .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 3c142307-02a1-4f18-b5e4-d0f37d92ccfaCited by top-tier papers28
- UniTS: A Unified Multi-Task Time Series ModelShanghua Gao, Teddy Koker, Owen Queen, Tom Hartvigsen et al.NeurIPS 2024 · 159 citations
- Medformer: A Multi-Granularity Patching Transformer for Medical Time-Series ClassificationYihe Wang, Nan Huang, Taida Li, Yujun Yan et al.NeurIPS 2024 · 158 citations
- Aurora: Towards Universal Generative Multimodal Time Series ForecastingXingjian Wu, Jianxin Jin, Wanghui Qiu, Peng Chen et al.ICLR 2026 · 33 citations
- Affirm: Interactive Mamba with Adaptive Fourier Filters for Long-term Time Series ForecastingYuhan Wu, Xiyu Meng, Huajin Hu, Junru Zhang et al.AAAI 2025 · 24 citations
- TimeSiam: A Pre-Training Framework for Siamese Time-Series ModelingJiaxiang Dong, Haixu Wu, Yuxuan Wang, Yunzhong Qiu et al.ICML 2024 · 23 citations
Builds on15
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Bootstrap Your Own Latent - A New Approach to Self-Supervised LearningJean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec et al.NeurIPS 2020 · 9,171 citations
- TS2Vec: Towards Universal Representation of Time SeriesZhihan Yue, Yujing Wang, Juanyong Duan, Tianmeng Yang et al.AAAI 2022 · 938 citations
- Self-Supervised Contrastive Pre-Training For Time Series via Time-Frequency ConsistencyXiang Zhang, Ziyuan Zhao, Theodoros Tsiligkaridis, Marinka ZitnikNeurIPS 2022 · 558 citations
- Unsupervised Representation Learning for Time Series with Temporal Neighborhood CodingSana Tonekaboni, Danny Eytan, Anna GoldenbergICLR 2021 · 386 citations
Related papers
- DAAC: Discrepancy-Aware Adaptive Contrastive Learning for Medical Time seriesYifan Wang, Hongfeng Ai, Ruiqi Li, Maowei Jiang et al.NeurIPS 2025
- CLOCS: Contrastive Learning of Cardiac Signals Across Space, Time, and PatientsDani Kiyasseh, Tingting Zhu, David A. CliftonICML 2021 · 30 citations
- Anatomical Invariance Modeling and Semantic Alignment for Self-supervised Learning in 3D Medical Image AnalysisYankai Jiang, Mingze Sun, Heng Guo, Xiaoyu Bai et al.ICCV 2023 · 38 citations
- Contrastive Learning for Unsupervised Domain Adaptation of Time SeriesYilmazcan Özyurt, Stefan Feuerriegel, Ce ZhangICLR 2023 · 25 citations
- MHCCL: Masked Hierarchical Cluster-Wise Contrastive Learning for Multivariate Time SeriesQianwen Meng, Hangwei Qian, Yong Liu, Lizhen Cui et al.AAAI 2023 · 54 citations
