Linguistic Priors for Visual Decoupling: Towards Symmetric Vision-Brain Alignment
Dongjun Liu, Weichen Dai, Jingsheng Qian, Honggang Liu, Hangjie Yi, Wanzeng Kong
摘要
Brain visual decoding aims to recognize and reconstruct perceptual visual content from neural activity, representing a promising avenue for developing brain-computer interfaces and building brain-inspired artificial intelligence. However, this task faces a fundamental challenge of information asymmetry: while natural images contain complex visual scenes with objects and backgrounds, the corresponding brain signals reflect focused attention on central objects while being contaminated by various neural noise. Previous methods that directly align visual and brain representations often overlook this inherent asymmetry, resulting in suboptimal decoding performance. To address this, we propose linguistic-prior-guided visual decoupling method, which introducing object-oriented textual descriptions as semantic guidance to explicitly decouple foreground objects from complex backgrounds in natural images, thereby establishing symmetric vision-brain alignment. This design enables the model to automatically focus on task-relevant visual concepts while effectively filtering out irrelevant neural noise in brain signals, achieving a transition from asymmetric feature alignment to semantic symmetric alignment. Extensive experiments on the THINGS-EEG and THINGS-MEG datasets demonstrate that our method achieves new state-of-the-art performance in the zero-shot brain-to-image retrieval task.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper8
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- Visual Decoding and Reconstruction via EEG Embeddings with Guided DiffusionDongyang Li, Chen Wei, Shiying Li, Jiachen Zou 等NeurIPS 2024 · 被引用 164 次
- Decoding Natural Images from EEG for Object RecognitionYonghao Song, Bingchuan Liu, Xiang Li, Nanlin Shi 等ICLR 2024 · 被引用 135 次
- Bridging the Semantic Latent Space between Brain and Machine: Similarity Is All You NeedJiaxuan Chen, Yu Qi, Yueming Wang, Gang PanAAAI 2024 · 被引用 13 次
- Bridging the Vision-Brain Gap with an Uncertainty-Aware Blur PriorHaitao Wu, Qing Li, Changqing Zhang, Zhen He 等CVPR 2025
相关 Paper
- ViEEG: Hierarchical Visual Neural Representation for EEG Brain DecodingMinxu Liu, Donghai Guan, Chuhang Zheng, Chunwei Tian 等ICML 2026 · 被引用 2 次
- Leveraging Visual Blur Perception Characteristics for EEG DecodingWenchao Liu, Hongwei Li, Zhouyang Xu, Lin Ma 等AAAI 2026
- Learning Brain Representation with Hierarchical Visual EmbeddingsJiawen Zheng, Haonan Jia, MING LI, Yuhui Zheng 等ICLR 2026 · 被引用 3 次
- HyFI: Hyperbolic Feature Interpolation for Brain-Vision AlignmentSangmin Jo, Wootaek Jeong, Da-Woon Heo, Yoohwan Hwang 等AAAI 2026 · 被引用 2 次
- NeuroBridge: Bio-Inspired Self-Supervised EEG-to-Image Decoding via Cognitive Priors and Bidirectional Semantic AlignmentWenjiang Zhang, Sifeng Wang, Yuwei Su, Xinyu Li 等AAAI 2026 · 被引用 7 次
