Assembling the Mind's Mosaic: Towards EEG Semantic Intent Decoding
Jiahe Li, Junru Chen, Fanqi Shen, Jialan Yang, Jada Li, Zhizhang Yuan, Baowen Cheng, Meng Li, Yang Yang
Abstract
Enabling natural communication through brain–computer interfaces (BCIs) remains one of the most profound challenges in neuroscience and neurotechnology. While existing frameworks offer partial solutions, they are constrained by oversimplified semantic representations and a lack of interpretability. To overcome these limitations, we introduce Semantic Intent Decoding(SID), a novel framework that translates neural activity into natural language by modeling meaning as a flexible set of compositional semantic units. SID is built on three core principles: semantic compositionality, continuity and expandability of semantic space, and fidelity in reconstruction. We present BrainMosaic, a deep learning architecture implementing SID. BrainMosaic decodes multiple semantic units from EEG/SEEG signals using set matching and then reconstructs coherent sentences through semantic-guided reconstruction. This approach moves beyond traditional pipelines that rely on fixed-class classification or unconstrained generation, enabling a more interpretable and expressive communication paradigm. Extensive experiments on multilingual EEG and clinical SEEG datasets demonstrate that SID and BrainMosaic offer substantial advantages over existing frameworks, paving the way for natural and effective BCI-mediated communication.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a9cf2075-2cad-402e-b2f0-2caff661e6b1Builds on6
- BERTScore: Evaluating Text Generation with BERTTianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q. Weinberger et al.ICLR 2020 · 8,443 citations
- Dynamic DETR: End-to-End Object Detection with Dynamic AttentionXiyang Dai, Yinpeng Chen, Jianwei Yang, Pengchuan Zhang et al.ICCV 2021 · 429 citations
- ModernTCN: A Modern Pure Convolution Structure for General Time Series AnalysisDonghao Luo, Xue WangICLR 2024 · 392 citations
- Du-IN: Discrete units-guided mask modeling for decoding speech from Intracranial Neural signalsHui Zheng, Haiteng Wang, Wei-Bang Jiang, Zhongtao Chen et al.NeurIPS 2024 · 22 citations
- Bridging the Gap Between Anchor-Based and Anchor-Free Detection via Adaptive Training Sample SelectionShifeng Zhang, Cheng Chi, Yongqiang Yao, Zhen Lei et al.CVPR 2020
Related papers
- MINDEV: Multi-modal Integrated Diffusion Framework for Video Reconstruction from EEG SignalsShuai Huang, Yongxiong Wang, Huan Luo, Haodong Jing et al.ACM MM 2025 · 1 citation
- A cross-species neural foundation model for end-to-end speech decodingYizi Zhang, Linyang He, Chaofei Fan, Tingkai Liu et al.ICLR 2026 · 5 citations
- Brain-Inspired fMRI-to-Text Decoding via Incremental and Wrap-Up Language ModelingWentao Lu, Dong Nie, Pengcheng Xue, Zheng Cui et al.NeurIPS 2025 · 3 citations
- BrainFLORA: Uncovering Brain Concept Representation via Multimodal Neural EmbeddingsDongyang Li, Haoyang Qin, Mingyang Wu, Chen Wei et al.ACM MM 2025 · 1 citation
- Neuro-SPO: Physically-Grounded and Affect-Aligned EEG-to-Keyword DecodingZihua Xu, C. L. Philip Chen, Tong ZhangKDD 2026
