PATCHCODE: Discrete Latent Predictive Learning for EEG Foundation Model
KIEREN YU, Ziyang Liu, Chang Huang, Kaishun WU
摘要
EEG foundation models aim to learn transferable representations, yet EEG recordings are dominated by high-frequency noise and large cross-subject variability. Existing pretraining strategies such as masked autoencoding or autoregressive modeling often treat waveform reconstruction as the learning signal, making the objective sensitive to stochastic fluctuations rather than consistent neurophysiological structure. To address this overlap, we propose PATCHCODE, a region-aware discrete predictive learning framework that keeps the encoder input continuous while introducing region-aware discrete codes as stable supervision targets. We pretrain a masked predictive encoder on continuous EEG patches with dual-granularity learning: it predicts missing patch-level representations to preserve fine spatiotemporal structure, while aligning them to discretized code targets from a frozen tokenizer to anchor robust semantics. Extensive experiments across sixteen downstream datasets spanning emotion recognition, motor imagery, sleep staging, seizure detection, vigilance estimation, stress detection, and clinical diagnosis demonstrate that PATCHCODE achieves competitive performance compared to state-of-the-art baselines, with notable gains in data efficiency under limited labels. Our code is available at https://github.com/kierenyyu/Patchcode.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper21
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah 等NeurIPS 2020 · 被引用 64,255 次
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn 等ICLR 2021 · 被引用 21,477 次
- wav2vec 2.0: A Framework for Self-Supervised Learning of Speech RepresentationsAlexei Baevski, Yuhao Zhou, Abdelrahman Mohamed, Michael AuliNeurIPS 2020 · 被引用 9,451 次
- Bootstrap Your Own Latent - A New Approach to Self-Supervised LearningJean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec 等NeurIPS 2020 · 被引用 9,171 次
- Emerging Properties in Self-Supervised Vision TransformersMathilde Caron, Hugo Touvron, Ishan Misra, Hervé Jégou 等ICCV 2021 · 被引用 8,921 次
相关 Paper
- REVE: A Foundation Model for EEG - Adapting to Any Setup with Large-Scale Pretraining on 25, 000 SubjectsYassine El Ouahidi, Jonathan Lys, Philipp Thölke, Nicolas Farrugia 等NeurIPS 2025 · 被引用 106 次
- RECTOR: Masked Region-Channel-Temporal Modeling for Affective and Cognitive Representation LearningJinhan Liu, Mahsa ShoaranICML 2026
- Uni-NTFM: A Unified Foundation Model for EEG Signal Representation LearningZhisheng Chen, Yingwei Zhang, Qizhen Lan, Tianyu Liu 等ICLR 2026 · 被引用 16 次
- CodeBrain: Bridging Decoupled Tokenizer and Multi-Scale Architecture for EEG Foundation ModelJingying Ma, Feng Wu, Qika Lin, Yucheng Xing 等ICLR 2026 · 被引用 25 次
- Resource Efficient Sleep Staging via Multi-Level Masking and Prompt LearningLejun Ai, Yulong Li, Haodong Yi, Jixuan Xie 等AAAI 2026
