SEBSFormer: A Spectral-Enhanced Bi-Stream Transformer for Robust EEG Decoding
Lin Zhang, Shikui Tu, Lei Xu
Abstract
Electroencephalography (EEG) plays a vital role in clinical and cognitive applications such as epilepsy diagnosis and emotion recognition. However, the low signal-to-noise ratio, inter-subject variability, and inherent non-stationarity of EEG signals present substantial modeling challenges. While recent Transformer-based models offer promising long-range modeling capabilities, their self-attention mechanism behaves as a low-pass filter, suppressing high-frequency neural patterns critical for decoding transient events. In this work, we provide the first formal analysis demonstrating this low-pass behavior in self-attention mechanisms when applied to EEG signals, revealing a fundamental limitation of deep attention-based EEG models. To address this, we propose SEBSFormer, a spectral-enhanced bi-Stream Transformer that jointly models temporal dependencies and spectral structures. SEBS-Former integrates three key modules: a spectral compensation module that restores high-frequency components via residual correction in the Fourier domain; a multi-scale temporal attention module for saliency-guided temporal compression; and a graph-guided dynamic fusion module for adaptive spatial aggregation across electrodes. Extensive experiments on three benchmark datasets-TUAB, TUEV, and SEED-demonstrate that SEBSFormer consistently outperforms existing state-of-the-art models across both clinical and affective tasks. Our findings establish a new paradigm for frequency-aware EEG modeling.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 85aa3fe0-8240-41bd-9b7f-2324faee6a60Builds on6
- BIOT: Biosignal Transformer for Cross-data Learning in the WildChaoqi Yang, M. Brandon Westover, Jimeng SunNeurIPS 2023 · 345 citations
- Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIWei-Bang Jiang, Li-Ming Zhao, Bao-Liang LuICLR 2024 · 298 citations
- Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to PracticePeihao Wang, Wenqing Zheng, Tianlong Chen, Zhangyang WangICLR 2022 · 212 citations
- An Attentive Inductive Bias for Sequential Recommendation beyond the Self-AttentionYehjin Shin, Jeongwhan Choi, Hyowon Wi, Noseong ParkAAAI 2024 · 130 citations
- ATD: Augmenting CP Tensor Decomposition by Self SupervisionChaoqi Yang, Cheng Qian, Navjot Singh, Cao (Danica) Xiao et al.NeurIPS 2022 · 14 citations
Related papers
- A foundation model with multi-variate parallel attention to generate neuronal activityFrancesco S. Carzaniga, Michael Hersche, Abu Sebastian, Kaspar Schindler et al.ICLR 2026 · 6 citations
- ScatterFormer: Locally-Invariant Scattering Transformer for Patient-Independent Multispectral Detection of Epileptiform DischargesRuizhe Zheng, Jun Li, Yi Wang, Tian Luo et al.AAAI 2023 · 10 citations
- TFF-Former: Temporal-Frequency Fusion Transformer for Zero-training Decoding of Two BCI TasksXujin Li, Wei Wei, Shuang Qiu, Huiguang HeACM MM 2022 · 27 citations
- CSBrain: A Cross-scale Spatiotemporal Brain Foundation Model for EEG DecodingYuchen Zhou, Jiamin Wu, Zichen Ren, Zhouheng Yao et al.NeurIPS 2025 · 71 citations
- A Multi-view Spectral-Spatial-Temporal Masked Autoencoder for Decoding Emotions with Self-supervised LearningRui Li, Yiting Wang, Wei-Long Zheng, Bao-Liang LuACM MM 2022 · 63 citations
