SEBSFormer: A Spectral-Enhanced Bi-Stream Transformer for Robust EEG Decoding
Lin Zhang, Shikui Tu, Lei Xu
摘要
Electroencephalography (EEG) plays a vital role in clinical and cognitive applications such as epilepsy diagnosis and emotion recognition. However, the low signal-to-noise ratio, inter-subject variability, and inherent non-stationarity of EEG signals present substantial modeling challenges. While recent Transformer-based models offer promising long-range modeling capabilities, their self-attention mechanism behaves as a low-pass filter, suppressing high-frequency neural patterns critical for decoding transient events. In this work, we provide the first formal analysis demonstrating this low-pass behavior in self-attention mechanisms when applied to EEG signals, revealing a fundamental limitation of deep attention-based EEG models. To address this, we propose SEBSFormer, a spectral-enhanced bi-Stream Transformer that jointly models temporal dependencies and spectral structures. SEBS-Former integrates three key modules: a spectral compensation module that restores high-frequency components via residual correction in the Fourier domain; a multi-scale temporal attention module for saliency-guided temporal compression; and a graph-guided dynamic fusion module for adaptive spatial aggregation across electrodes. Extensive experiments on three benchmark datasets-TUAB, TUEV, and SEED-demonstrate that SEBSFormer consistently outperforms existing state-of-the-art models across both clinical and affective tasks. Our findings establish a new paradigm for frequency-aware EEG modeling.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper6
- BIOT: Biosignal Transformer for Cross-data Learning in the WildChaoqi Yang, M. Brandon Westover, Jimeng SunNeurIPS 2023 · 被引用 345 次
- Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIWei-Bang Jiang, Li-Ming Zhao, Bao-Liang LuICLR 2024 · 被引用 298 次
- Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to PracticePeihao Wang, Wenqing Zheng, Tianlong Chen, Zhangyang WangICLR 2022 · 被引用 212 次
- An Attentive Inductive Bias for Sequential Recommendation beyond the Self-AttentionYehjin Shin, Jeongwhan Choi, Hyowon Wi, Noseong ParkAAAI 2024 · 被引用 130 次
- ATD: Augmenting CP Tensor Decomposition by Self SupervisionChaoqi Yang, Cheng Qian, Navjot Singh, Cao (Danica) Xiao 等NeurIPS 2022 · 被引用 14 次
相关 Paper
- A foundation model with multi-variate parallel attention to generate neuronal activityFrancesco S. Carzaniga, Michael Hersche, Abu Sebastian, Kaspar Schindler 等ICLR 2026 · 被引用 6 次
- ScatterFormer: Locally-Invariant Scattering Transformer for Patient-Independent Multispectral Detection of Epileptiform DischargesRuizhe Zheng, Jun Li, Yi Wang, Tian Luo 等AAAI 2023 · 被引用 10 次
- TFF-Former: Temporal-Frequency Fusion Transformer for Zero-training Decoding of Two BCI TasksXujin Li, Wei Wei, Shuang Qiu, Huiguang HeACM MM 2022 · 被引用 27 次
- CSBrain: A Cross-scale Spatiotemporal Brain Foundation Model for EEG DecodingYuchen Zhou, Jiamin Wu, Zichen Ren, Zhouheng Yao 等NeurIPS 2025 · 被引用 71 次
- A Multi-view Spectral-Spatial-Temporal Masked Autoencoder for Decoding Emotions with Self-supervised LearningRui Li, Yiting Wang, Wei-Long Zheng, Bao-Liang LuACM MM 2022 · 被引用 63 次
