Neighborhood Contrastive Learning Applied to Online Patient Monitoring
Hugo Yèche, Gideon Dresdner, Francesco Locatello, Matthias Hüser, Gunnar Rätsch
Abstract
Intensive care units (ICU) are increasingly looking towards machine learning for methods to provide online monitoring of critically ill patients. In machine learning, online monitoring is often formulated as a supervised learning problem. Recently, contrastive learning approaches have demonstrated promising improvements over competitive supervised benchmarks. These methods rely on well-understood data augmentation techniques developed for image data which do not apply to online monitoring. In this work, we overcome this limitation by supplementing time-series data augmentation techniques with a novel contrastive learning objective which we call neighborhood contrastive learning (NCL). Our objective explicitly groups together contiguous time segments from each patient while maintaining state-specific information. Our experiments demonstrate a marked improvement over existing work applying contrastive methods to medical time-series.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers13
- SimMTM: A Simple Pre-Training Framework for Masked Time-Series ModelingJiaxiang Dong, Haixu Wu, Haoran Zhang, Li Zhang et al.NeurIPS 2023 · 225 citations
- Contrast Everything: A Hierarchical Contrastive Framework for Medical Time-SeriesYihe Wang, Yu Han, Haishuai Wang, Xiang ZhangNeurIPS 2023 · 106 citations
- Soft Contrastive Learning for Time SeriesSeunghan Lee, Taeyoung Park, Kibok LeeICLR 2024 · 63 citations
- Contrastive Learning for Unsupervised Domain Adaptation of Time SeriesYilmazcan Özyurt, Stefan Feuerriegel, Ce ZhangICLR 2023 · 25 citations
- Towards Enhancing Time Series Contrastive Learning: A Dynamic Bad Pair Mining ApproachXiang Lan, Hanshu Yan, Shenda Hong, Mengling FengICLR 2024 · 21 citations
Builds on9
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Supervised Contrastive LearningPrannay Khosla, Piotr Teterwak, Chen Wang, Aaron Sarna et al.NeurIPS 2020 · 7,049 citations
- Unsupervised Learning of Visual Features by Contrasting Cluster AssignmentsMathilde Caron, Ishan Misra, Julien Mairal, Priya Goyal et al.NeurIPS 2020 · 5,249 citations
- Big Self-Supervised Models are Strong Semi-Supervised LearnersTing Chen, Simon Kornblith, Kevin Swersky, Mohammad Norouzi et al.NeurIPS 2020 · 2,611 citations
- Understanding Contrastive Representation Learning through Alignment and Uniformity on the HypersphereTongzhou Wang, Phillip IsolaICML 2020 · 2,360 citations
Related papers
- CLOCS: Contrastive Learning of Cardiac Signals Across Space, Time, and PatientsDani Kiyasseh, Tingting Zhu, David A. CliftonICML 2021 · 30 citations
- Unsupervised Representation Learning for Time Series with Temporal Neighborhood CodingSana Tonekaboni, Danny Eytan, Anna GoldenbergICLR 2021 · 386 citations
- Utilizing Expert Features for Contrastive Learning of Time-Series RepresentationsManuel T. Nonnenmacher, Lukas Oldenburg, Ingo Steinwart, David ReebICML 2022 · 27 citations
- Time Series Contrastive Learning with Information-Aware AugmentationsDongsheng Luo, Wei Cheng, Yingheng Wang, Dongkuan Xu et al.AAAI 2023 · 121 citations
- Contrastive ClusteringYunfan Li, Peng Hu, Jerry Zitao Liu, Dezhong Peng et al.AAAI 2021 · 798 citations
