Lightweight Transformer for EEG Classification via Balanced Signed Graph Algorithm Unrolling
Junyi Yao, Parham Eftekhar, Gene Cheung, Xujin Chris Liu, Yao Wang, Wei Hu
Abstract
Samples of brain signals collected by EEG sensors have inherent anti-correlations that are well modeled by negative edges in a finite graph. To differentiate epilepsy patients from healthy subjects using collected EEG signals, we build lightweight and interpretable transformer-like neural nets by unrolling a spectral denoising algorithm for signals on a balanced signed graph---graph with no cycles of odd number of negative edges. A balanced signed graph has well-defined frequencies that map to a corresponding positive graph via similarity transform of the graph Laplacian matrices. We implement an ideal low-pass filter efficiently on the mapped positive graph via Lanczos approximation, where the optimal cutoff frequency is learned from data. Given that two balanced signed graph denoisers learn posterior probabilities of two different signal classes during training, we evaluate their reconstruction errors for binary classification of EEG signals. Experiments show that our method achieves classification performance comparable to representative deep learning schemes, while employing dramatically fewer parameters.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on6
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Text-to-Image Diffusion Models are Zero Shot ClassifiersKevin Clark, Priyank JainiNeurIPS 2023 · 192 citations
- White-Box Transformers via Sparse Rate ReductionYaodong Yu, Sam Buchanan, Druv Pai, Tianzhe Chu et al.NeurIPS 2023 · 149 citations
- MAtt: A Manifold Attention Network for EEG DecodingYue-Ting Pan, Jing-Lun Chou, Chun-Shu WeiNeurIPS 2022 · 105 citations
- Interpretable Lightweight Transformer via Unrolling of Learned Graph Smoothness PriorsViet Ho Tam Thuc Do, Parham Eftekhar, Seyed Alireza Hosseini, Gene Cheung et al.NeurIPS 2024 · 13 citations
Related papers
- Self-Supervised Graph Neural Networks for Improved Electroencephalographic Seizure AnalysisSiyi Tang, Jared Dunnmon, Khaled Kamal Saab, Xuan Zhang et al.ICLR 2022 · 157 citations
- iEDeaL: A Deep Learning Framework for Detecting Highly Imbalanced Interictal Epileptiform DischargesQitong Wang, Stephen Whitmarsh, Vincent Navarro, Themis PalpanasVLDB 2023 · 15 citations
- Signed Laplacian Graph Neural NetworksYu Li, Meng Qu, Jian Tang, Yi ChangAAAI 2023 · 19 citations
- RSGNN: A Model-agnostic Approach for Enhancing the Robustness of Signed Graph Neural NetworksZeyu Zhang, Jiamou Liu, Xianda Zheng, Yifei Wang et al.WWW 2023 · 32 citations
- Self-Supervised Learning for Anomalous Channel Detection in EEG Graphs: Application to Seizure AnalysisThi Kieu Khanh Ho, Narges ArmanfardAAAI 2023 · 58 citations
