SOM-CPC: Unsupervised Contrastive Learning with Self-Organizing Maps for Structured Representations of High-Rate Time Series
Iris A. M. Huijben, Arthur Andreas Nijdam, Sebastiaan Overeem, Merel M. van Gilst, Ruud van Sloun
摘要
Continuous monitoring with an ever-increasing number of sensors has become ubiquitous across many application domains. However, acquired time series are typically high-dimensional and difficult to interpret. Expressive deep learning (DL) models have gained popularity for dimensionality reduction, but the resulting latent space often remains difficult to interpret. In this work we propose SOM-CPC, a model that visualizes data in an organized 2D manifold, while preserving higher-dimensional information. We address a largely unexplored and challenging set of scenarios comprising high-rate time series, and show on both synthetic and real-life data (physiological data and audio recordings) that SOM-CPC outperforms strong baselines like DL-based feature extraction, followed by conventional dimensionality reduction techniques, and models that jointly optimize a DL model and a Self-Organizing Map (SOM). SOM-CPC has great potential to acquire a better understanding of latent patterns in high-rate data streams.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper2
- Learning Flexible Time-windowed Granger Causality Integrating Heterogeneous Interventional Time Series DataZiyi Zhang, Shaogang Ren, Xiaoning Qian, Nick DuffieldKDD 2024 · 被引用 5 次
- FreRA: A Frequency-Refined Augmentation for Contrastive Learning on Time Series ClassificationTian Tian, Chunyan Miao, Hangwei QianKDD 2025 · 被引用 4 次
它引用的顶会 Paper4
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 被引用 24,064 次
- Contrastive Learning Inverts the Data Generating ProcessRoland S. Zimmermann, Yash Sharma, Steffen Schneider, Matthias Bethge 等ICML 2021 · 被引用 264 次
- Temporal Phenotyping using Deep Predictive Clustering of Disease ProgressionChanghee Lee, Mihaela van der SchaarICML 2020 · 被引用 66 次
- Momentum Contrast for Unsupervised Visual Representation LearningKaiming He, Haoqi Fan, Yuxin Wu, Saining Xie 等CVPR 2020
相关 Paper
- Credit-based self organizing maps: training deep topographic networks with minimal performance degradationAmirozhan Dehghani, Xinyu Qian, Asa Farahani, Pouya BashivanICLR 2025
- Sequential Multi-Dimensional Self-Supervised Learning for Clinical Time SeriesAniruddh Raghu, Payal Chandak, Ridwan Alam, John V. Guttag 等ICML 2023 · 被引用 18 次
- Contrastive Predictive Coding for Human Activity RecognitionHarish Haresamudram, Irfan A. Essa, Thomas PlötzUbiComp 2021 · 被引用 149 次
- URLOST: Unsupervised Representation Learning without Stationarity or TopologyZeyu Yun, Juexiao Zhang, Yann LeCun, Yubei ChenICLR 2025
- Extraction and Interpretation of Deep Autoencoder-based Temporal Features from Wearables for Forecasting Personalized Mood, Health, and StressBoning Li, Akane SanoUbiComp 2020 · 被引用 98 次
