Spontaneous Yet Predictable: Shapelet-Driven, Channel-Aware Intention Decoding from Multi-Region ECoG
Keren Cao, Yuhang Tian, Kaizhong Zheng, Wei Xi, Xinjian Li, Liangjun Chen
Abstract
Proactive intention decoding remains a critical yet underexplored challenge in brain–machine interfaces (BMIs), especially under naturalistic, self-initiated behavior. Existing systems rely on reactive decoding of motor cortex signals, resulting in substantial latency. To address this, we leverage the common marmoset’s spontaneous vocalizations and develop a high-resolution, dual-region ECoG recording paradigm targeting the prefrontal and auditory cortices and a neural decoding framework that integrates shapelet-based temporal encoding, position-aware attention, frequency-aware channel masking, contrastive clustering and a minimum error entropy-based robust loss. Our approach achieves 91.9% accuracy up to 200 ms before vocal onset—substantially outperforming 13 competitive baselines. Our model also uncovers a functional decoupling between auditory and prefrontal regions. Furthermore, joint modeling in time and frequency domains reveals novel preparatory neural signatures preceding volitional vocal output. Together, our findings bridge the gap between foundational neuroscience and applied BMI engineering, and establish a generalizable framework for intention decoding from ecologically valid, asynchronous behaviors.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on12
- Informer: Beyond Efficient Transformer for Long Sequence Time-Series ForecastingHaoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang et al.AAAI 2021 · 7,289 citations
- Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series ForecastingHaixu Wu, Jiehui Xu, Jianmin Wang, Mingsheng LongNeurIPS 2021 · 5,824 citations
- FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series ForecastingTian Zhou, Ziqing Ma, Qingsong Wen, Xue Wang et al.ICML 2022 · 2,912 citations
- iTransformer: Inverted Transformers Are Effective for Time Series ForecastingYong Liu, Tengge Hu, Haoran Zhang, Haixu Wu et al.ICLR 2024 · 1,703 citations
- MiniRocket: A Very Fast (Almost) Deterministic Transform for Time Series ClassificationAngus Dempster, Daniel F. Schmidt, Geoffrey I. WebbKDD 2021 · 395 citations
Related papers
- Neural Latent Aligner: Cross-trial Alignment for Learning Representations of Complex, Naturalistic Neural DataCheol Jun Cho, Edward F. Chang, Gopala Krishna AnumanchipalliICML 2023 · 10 citations
- Pretraining Large Brain Language Model for Active BCI: Silent SpeechJinzhao Zhou, Zehong Cao, Yiqun Duan, Connor Barkley et al.ACM MM 2025 · 2 citations
- MindMix: A Multimodal Foundation Model for Auditory Perception Decoding via Deep Neural-Acoustic AlignmentRUI LIU, Zhige Chen, Pengshu, Wenlong You et al.ICLR 2026
- Temporal Precision Matters: Brain-Tuning Speech Language Models with Millisecond-Resolution Neural SignalsZhejun Zhang, Wenqing Zhou, Haozhe Xu, Lin Zhang et al.ACL 2026
- CAT-Net: A Cross-Attention Tone Network for Cross-Subject EEG-EMG Fusion Tone DecodingYifan Zhuang, Calvin Huang, Zepeng Yu, Yongjie Zou et al.AAAI 2026
