CLOCS: Contrastive Learning of Cardiac Signals Across Space, Time, and Patients
Dani Kiyasseh, Tingting Zhu, David A. Clifton
Abstract
The healthcare industry generates troves of unlabelled physiological data. This data can be exploited via contrastive learning, a self-supervised pre-training method that encourages representations of instances to be similar to one another. We propose a family of contrastive learning methods, CLOCS, that encourages representations across space, time, and patients to be similar to one another. We show that CLOCS consistently outperforms the state-of-the-art methods, BYOL and SimCLR, when performing a linear evaluation of, and fine-tuning on, downstream tasks. We also show that CLOCS achieves strong generalization performance with only 25% of labelled training data. Furthermore, our training procedure naturally generates patient-specific representations that can be used to quantify patient-similarity.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext df634e66-7b25-4ea6-b949-c12694183b03Cited by top-tier papers32
- Self-Supervised Contrastive Pre-Training For Time Series via Time-Frequency ConsistencyXiang Zhang, Ziyuan Zhao, Theodoros Tsiligkaridis, Marinka ZitnikNeurIPS 2022 · 558 citations
- Medformer: A Multi-Granularity Patching Transformer for Medical Time-Series ClassificationYihe Wang, Nan Huang, Taida Li, Yujun Yan et al.NeurIPS 2024 · 158 citations
- Large-scale Training of Foundation Models for Wearable BiosignalsSalar Abbaspourazad, Oussama Elachqar, Andrew C. Miller, Saba Emrani et al.ICLR 2024 · 112 citations
- Contrast Everything: A Hierarchical Contrastive Framework for Medical Time-SeriesYihe Wang, Yu Han, Haishuai Wang, Xiang ZhangNeurIPS 2023 · 106 citations
- Guiding Masked Representation Learning to Capture Spatio-Temporal Relationship of ElectrocardiogramYeongyeon Na, Minje Park, Yunwon Tae, Sunghoon JooICLR 2024 · 92 citations
Builds on3
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Bootstrap Your Own Latent - A New Approach to Self-Supervised LearningJean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec et al.NeurIPS 2020 · 9,171 citations
- Momentum Contrast for Unsupervised Visual Representation LearningKaiming He, Haoqi Fan, Yuxin Wu, Saining Xie et al.CVPR 2020
Related papers
- CROCS: Clustering and Retrieval of Cardiac Signals Based on Patient Disease Class, Sex, and AgeDani Kiyasseh, Tingting Zhu, David A. CliftonNeurIPS 2021 · 10 citations
- The Close Relationship Between Contrastive Learning and Meta-LearningRenkun Ni, Manli Shu, Hossein Souri, Micah Goldblum et al.ICLR 2022 · 16 citations
- Crafting Better Contrastive Views for Siamese Representation LearningXiangyu Peng, Kai Wang, Zheng Zhu, Mang Wang et al.CVPR 2022 · 107 citations
- Preservational Learning Improves Self-supervised Medical Image Models by Reconstructing Diverse ContextsHong-Yu Zhou, Chixiang Lu, Sibei Yang, Xiaoguang Han et al.ICCV 2021 · 104 citations
- Neighborhood Contrastive Learning Applied to Online Patient MonitoringHugo Yèche, Gideon Dresdner, Francesco Locatello, Matthias Hüser et al.ICML 2021 · 58 citations
