SPINT: Spatial Permutation-Invariant Neural Transformer for Consistent Intracortical Motor Decoding
Trung Le, Hao Fang, Jingyuan Li, Tung Nguyen, Lu Mi, Amy L. Orsborn, Uygar Sümbül, Eli Shlizerman
摘要
Intracortical Brain-Computer Interfaces (iBCI) aim to decode behavior from neural population activity, enabling individuals with motor impairments to regain motor functions and communication abilities. A key challenge in long-term iBCI is the nonstationarity of neural recordings, where the composition and tuning profiles of the recorded populations are unstable across recording sessions. Existing methods attempt to address this issue by explicit alignment techniques; however, they rely on fixed neural identities and require test-time labels or parameter updates, limiting their generalization across sessions and imposing additional computational burden during deployment. In this work, we introduce SPINT - a Spatial Permutation-Invariant Neural Transformer framework for behavioral decoding that operates directly on unordered sets of neural units. Central to our approach is a novel context-dependent positional embedding scheme that dynamically infers unit-specific identities, enabling flexible generalization across recording sessions. SPINT supports inference on variable-size populations and allows few-shot, gradient-free adaptation using a small amount of unlabeled data from the test session. To further promote model robustness to population variability, we introduce dynamic channel dropout, a regularization method for iBCI that simulates shifts in population composition during training. We evaluate SPINT on three multi-session datasets from the FALCON Benchmark, covering continuous motor decoding tasks in human and non-human primates. SPINT demonstrates robust cross-session generalization, outperforming existing zero-shot and few-shot unsupervised baselines while eliminating the need for test-time alignment and fine-tuning. Our work contributes an initial step toward a robust and scalable neural decoding framework for long-term iBCI applications.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper16
- A Unified, Scalable Framework for Neural Population DecodingMehdi Azabou, Vinam Arora, Venkataramana Ganesh, Ximeng Mao 等NeurIPS 2023 · 被引用 136 次
- Neural Data Transformer 2: Multi-context Pretraining for Neural Spiking ActivityJoel Ye, Jennifer L. Collinger, Leila Wehbe, Robert A. GauntNeurIPS 2023 · 被引用 100 次
- Inferring Latent Dynamics Underlying Neural Population Activity via Neural Differential EquationsTimothy Doyeon Kim, Thomas Zhihao Luo, Jonathan W. Pillow, Carlos D. BrodyICML 2021 · 被引用 62 次
- Towards a "Universal Translator" for Neural Dynamics at Single-Cell, Single-Spike ResolutionYizi Zhang, Yanchen Wang, Donato Jiménez-Benetó, Zixuan Wang 等NeurIPS 2024 · 被引用 59 次
- STNDT: Modeling Neural Population Activity with Spatiotemporal TransformersTrung Le, Eli ShlizermanNeurIPS 2022 · 被引用 40 次
相关 Paper
- Robust alignment of cross-session recordings of neural population activity by behaviour via unsupervised domain adaptationJustin Jude, Matthew G. Perich, Lee E. Miller, Matthias H. HennigICML 2022 · 被引用 26 次
- Multi-dimensional Neural Decoding with Orthogonal Representations for Brain-Computer InterfacesKaixi Tian, Shengjia Zhao, Yuhan Zhang, Shan YuAAAI 2026 · 被引用 1 次
- CRRL: Learning Channel-invariant Neural Representations for High-performance Cross-day DecodingXianhan Tan, Binli Luo, Yu Qi, Yueming WangNeurIPS 2025
- Population Transformer: Learning Population-level Representations of Neural ActivityGeeling Chau, Christopher Wang, Sabera J. Talukder, Vighnesh Subramaniam 等ICLR 2025
- Neural Representational Consistency Emerges from Probabilistic Neural-Behavioral Representation AlignmentYu Zhu, Chunfeng Song, Wanli Ouyang, Shan Yu 等ICML 2025
