See the Emotion: A Facial Emoji Proxy Modeling for EEG Emotion Recognition
Jingjing Hu, Dan Guo, Haofan Cheng, Zeng ying, Zhan Si, Jinxing Zhou, Meng Wang
Abstract
Despite the high accuracy of EEG-based emotion recognition, existing models remain opaque "black boxes", lacking semantic grounding between abstract neural features and human-interpretable states. In this paper, we reframe EEG explainability as a cross-modal generation task, shifting the paradigm from feature attribution to behavioral visualization. We introduce Facial Emoji Proxy Modeling, a novel framework that translates high-dimensional EEG signals into identity-anonymized facial emojis. Guided by the neuroscientific inspiration of neural-facial association, this approach grounds neural representations in the manifold of observable facial dynamics. Technically, our framework integrates FMENet, a specialized backbone modeling expression-relevant spatial synergies, and the Facial Emoji Learning Branch (FELB), which treats emoji reconstruction as a structured semantic regularizer. Extensive experiments on EAV and MMER benchmarks demonstrate that our method achieves state-of-the-art accuracy among EEG-only models. Crucially, it generates semantically faithful facial animations that provide a transparent, privacy-preserving window into the brain's emotional evolution, effectively allowing users to ``see the emotion'' directly from neural signals. Code is available at https://github.com/xian-sh/SeeEmotion
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 33fdf4a3-118a-4405-9ac1-daeb36c2a317Builds on1
Related papers
- EEG-SCMM: Soft Contrastive Masked Modeling for Cross-Corpus EEG-Based Emotion RecognitionQile Liu, Weishan Ye, Lingli Zhang, Zhen LiangACM MM 2025 · 1 citation
- Cross-Modal Emotion Transfer for Emotion Editing in Talking Face VideoChanhyuk Choi, Taesoo Kim, Donggyu Lee, Siyeol Jung et al.CVPR 2026 · 1 citation
- A Brain-Inspired Way of Reducing the Network Complexity via Concept-Regularized Coding for Emotion RecognitionHan Lu, Xiahai Zhuang, Qiang LuoAAAI 2024
- Multimodal Adaptive Emotion Transformer with Flexible Modality Inputs on A Novel Dataset with Continuous LabelsWei-Bang Jiang, Xuan-Hao Liu, Wei-Long Zheng, Bao-Liang LuACM MM 2023 · 44 citations
- EMOD: A Unified EEG Emotion Representation Framework Leveraging V-A Guided Contrastive LearningYuning Chen, Sha Zhao, Shijian Li, Gang PanAAAI 2026
