CLOCS: Contrastive Learning of Cardiac Signals Across Space, Time, and Patients
Dani Kiyasseh, Tingting Zhu, David A. Clifton
摘要
The healthcare industry generates troves of unlabelled physiological data. This data can be exploited via contrastive learning, a self-supervised pre-training method that encourages representations of instances to be similar to one another. We propose a family of contrastive learning methods, CLOCS, that encourages representations across space, time, and patients to be similar to one another. We show that CLOCS consistently outperforms the state-of-the-art methods, BYOL and SimCLR, when performing a linear evaluation of, and fine-tuning on, downstream tasks. We also show that CLOCS achieves strong generalization performance with only 25% of labelled training data. Furthermore, our training procedure naturally generates patient-specific representations that can be used to quantify patient-similarity.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper32
- Self-Supervised Contrastive Pre-Training For Time Series via Time-Frequency ConsistencyXiang Zhang, Ziyuan Zhao, Theodoros Tsiligkaridis, Marinka ZitnikNeurIPS 2022 · 被引用 558 次
- Medformer: A Multi-Granularity Patching Transformer for Medical Time-Series ClassificationYihe Wang, Nan Huang, Taida Li, Yujun Yan 等NeurIPS 2024 · 被引用 158 次
- Large-scale Training of Foundation Models for Wearable BiosignalsSalar Abbaspourazad, Oussama Elachqar, Andrew C. Miller, Saba Emrani 等ICLR 2024 · 被引用 112 次
- Contrast Everything: A Hierarchical Contrastive Framework for Medical Time-SeriesYihe Wang, Yu Han, Haishuai Wang, Xiang ZhangNeurIPS 2023 · 被引用 106 次
- Guiding Masked Representation Learning to Capture Spatio-Temporal Relationship of ElectrocardiogramYeongyeon Na, Minje Park, Yunwon Tae, Sunghoon JooICLR 2024 · 被引用 92 次
它引用的顶会 Paper3
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 被引用 24,064 次
- Bootstrap Your Own Latent - A New Approach to Self-Supervised LearningJean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec 等NeurIPS 2020 · 被引用 9,171 次
- Momentum Contrast for Unsupervised Visual Representation LearningKaiming He, Haoqi Fan, Yuxin Wu, Saining Xie 等CVPR 2020
相关 Paper
- CROCS: Clustering and Retrieval of Cardiac Signals Based on Patient Disease Class, Sex, and AgeDani Kiyasseh, Tingting Zhu, David A. CliftonNeurIPS 2021 · 被引用 10 次
- The Close Relationship Between Contrastive Learning and Meta-LearningRenkun Ni, Manli Shu, Hossein Souri, Micah Goldblum 等ICLR 2022 · 被引用 16 次
- Crafting Better Contrastive Views for Siamese Representation LearningXiangyu Peng, Kai Wang, Zheng Zhu, Mang Wang 等CVPR 2022 · 被引用 107 次
- Preservational Learning Improves Self-supervised Medical Image Models by Reconstructing Diverse ContextsHong-Yu Zhou, Chixiang Lu, Sibei Yang, Xiaoguang Han 等ICCV 2021 · 被引用 104 次
- Neighborhood Contrastive Learning Applied to Online Patient MonitoringHugo Yèche, Gideon Dresdner, Francesco Locatello, Matthias Hüser 等ICML 2021 · 被引用 58 次
