EEG-SCMM: Soft Contrastive Masked Modeling for Cross-Corpus EEG-Based Emotion Recognition
Qile Liu, Weishan Ye, Lingli Zhang, Zhen Liang
Abstract
Emotion recognition using electroencephalography (EEG) signals has attracted increasing attention in recent years. However, existing methods often lack generalization in cross-corpus settings, where a model trained on one dataset is directly applied to another without retraining, due to differences in data distribution and recording conditions. To tackle the challenge of cross-corpus EEG-based emotion recognition, we propose a novel framework termed Soft Contrastive Masked Modeling (SCMM). Grounded in the theory of emotional continuity, SCMM integrates soft contrastive learning with a hybrid masking strategy to effectively capture emotion dynamics (refer to short-term continuity). Specifically, in the self-supervised learning stage, we propose a soft weighting mechanism that assigns similarity scores to sample pairs, enabling fine-grained modeling of emotional transitions and capturing the temporal continuity of human emotions. To further enhance representation learning, we design a similarity-aware aggregator that fuses complementary information from semantically related samples based on pairwise similarities, thereby improving feature expressiveness and reconstruction quality. This dual design contributes to a more discriminative and transferable representation, which is crucial for robust cross-corpus generalization. Extensive experiments on the SEED, SEED-IV, and DEAP datasets show that SCMM achieves state-of-the-art (SOTA) performance, outperforming the second-best method by an average accuracy of 4.26% under both same-class and different-class cross-corpus settings. The source code is available at https://github.com/Kyler-RL/SCMM.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 43dc5d6f-76ba-4e91-bef8-2d347e1481acCited by top-tier papers1
Ask how each one uses itBuilds on10
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- With a Little Help from My Friends: Nearest-Neighbor Contrastive Learning of Visual RepresentationsDebidatta Dwibedi, Yusuf Aytar, Jonathan Tompson, Pierre Sermanet et al.ICCV 2021 · 542 citations
- Plug-and-Play Domain Adaptation for Cross-Subject EEG-based Emotion RecognitionLi-Ming Zhao, Xu Yan, Bao-Liang LuAAAI 2021 · 154 citations
- A Multi-view Spectral-Spatial-Temporal Masked Autoencoder for Decoding Emotions with Self-supervised LearningRui Li, Yiting Wang, Wei-Long Zheng, Bao-Liang LuACM MM 2022 · 63 citations
Related papers
- EMOD: A Unified EEG Emotion Representation Framework Leveraging V-A Guided Contrastive LearningYuning Chen, Sha Zhao, Shijian Li, Gang PanAAAI 2026
- DHCM-CACL: Dynamic Hierarchical Cross-modal Mamba with Confidence-Adaptive Contrastive Learning for Multimodal Emotion RecognitionBaiqiang Wu, Yang LiAAAI 2026 · 1 citation
- Sera: Separated Coarse-to-fine Representation Alignment for Cross-subject EEG-based Emotion RecognitionZhihao Jia, Meiyan Xu, Jingyuan Wang, Ziyu Jia et al.ACM MM 2025 · 2 citations
- REmoNet: Reducing Emotional Label Noise via Multi-regularized Self-supervisionWei-Bang Jiang, Yu-Ting Lan, Bao-Liang LuACM MM 2024 · 3 citations
- DMMR: Cross-Subject Domain Generalization for EEG-Based Emotion Recognition via Denoising Mixed Mutual ReconstructionYiming Wang, Bin Zhang, Yujiao TangAAAI 2024 · 51 citations
