NEED: Cross-Subject and Cross-Task Generalization for Video and Image Reconstruction from EEG Signals
Shuai Huang, Huan Luo, Haodong Jing, Qixian Zhang, Litao Chang, Yating Feng, Xiao Lin, Chendong Qin, Han Chen, Shuwen Jia, Siyi Sun, Yongxiong Wang
摘要
Translating brain activity into meaningful visual content has long been recognized as a fundamental challenge in neuroscience and brain-computer interface research. Recent advances in EEG-based neural decoding have shown promise, yet two critical limitations remain in this area: poor generalization across subjects and constraints to specific visual tasks. We introduce NEED, the first unified framework achieving zero-shot cross-subject and cross-task generalization for EEG-based visual reconstruction. Our approach addresses three fundamental challenges: (1) cross-subject variability through an Individual Adaptation Module pretrained on multiple EEG datasets to normalize subject-specific patterns, (2) limited spatial resolution and complex temporal dynamics via a dual-pathway architecture capturing both low-level visual dynamics and high-level semantics, and (3) task specificity constraints through a unified inference mechanism adaptable to different visual domains. For video reconstruction, NEED achieves better performance than existing methods. Importantly, Our model maintains 93.7% of within-subject classification performance and 92.4% of visual reconstruction quality when generalizing to unseen subjects, while achieving an SSIM of 0.352 when transferring directly to static image reconstruction without fine-tuning, demonstrating how neural decoding can move beyond subject and task boundaries toward truly generalizable brain-computer interfaces.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper2
- Make LVLMs Focus: Context-Aware Attention Modulation for Better Multimodal In-Context LearningYanshu Li, Jianjiang Yang, Ziteng Yang, Bozheng Li 等AAAI 2026 · 被引用 9 次
- Beyond N-grams: A Hierarchical Reward Learning Framework for Clinically-Aware Medical Report GenerationYuan Wang, Shujian Gao, Jiaxiang Liu, Songtao Jiang 等AAAI 2026 · 被引用 2 次
它引用的顶会 Paper21
- Reconstructing the Mind's Eye: fMRI-to-Image with Contrastive Learning and Diffusion PriorsPaul S. Scotti, Atmadeep Banerjee, Jimmie Goode, Stepan Shabalin 等NeurIPS 2023 · 被引用 282 次
- EEGPT: Pretrained Transformer for Universal and Reliable Representation of EEG SignalsGuangyu Wang, Wenchao Liu, Yuhong He, Cong Xu 等NeurIPS 2024 · 被引用 267 次
- Toward a realistic model of speech processing in the brain with self-supervised learningJuliette Millet, Charlotte Caucheteux, Pierre Orhan, Yves Boubenec 等NeurIPS 2022 · 被引用 164 次
- Mind Reader: Reconstructing complex images from brain activitiesSikun Lin, Thomas Sprague, Ambuj K. SinghNeurIPS 2022 · 被引用 155 次
- Plug-and-Play Domain Adaptation for Cross-Subject EEG-based Emotion RecognitionLi-Ming Zhao, Xu Yan, Bao-Liang LuAAAI 2021 · 被引用 154 次
相关 Paper
- EVOKE: Efficient and High-Fidelity EEG-to-Video Reconstruction via Decoupling Implicit Neural RepresentationHaodong Jing, Panqi Yang, Dongyao Jiang, Zhipeng Liu 等AAAI 2026 · 被引用 1 次
- Visual Decoding and Reconstruction via EEG Embeddings with Guided DiffusionDongyang Li, Chen Wei, Shiying Li, Jiachen Zou 等NeurIPS 2024 · 被引用 164 次
- ZEBRA: Towards Zero-Shot Cross-Subject Generalization for Universal Brain Visual DecodingHaonan Wang, Jingyu Lu, Hongrui Li, Xiaomeng LiNeurIPS 2025 · 被引用 8 次
- EEG2Video: Towards Decoding Dynamic Visual Perception from EEG SignalsXuan-Hao Liu, Yan-Kai Liu, Yansen Wang, Kan Ren 等NeurIPS 2024 · 被引用 59 次
- MINDEV: Multi-modal Integrated Diffusion Framework for Video Reconstruction from EEG SignalsShuai Huang, Yongxiong Wang, Huan Luo, Haodong Jing 等ACM MM 2025 · 被引用 1 次
