Linguistic Priors for Visual Decoupling: Towards Symmetric Vision-Brain Alignment
Dongjun Liu, Weichen Dai, Jingsheng Qian, Honggang Liu, Hangjie Yi, Wanzeng Kong
Abstract
Brain visual decoding aims to recognize and reconstruct perceptual visual content from neural activity, representing a promising avenue for developing brain-computer interfaces and building brain-inspired artificial intelligence. However, this task faces a fundamental challenge of information asymmetry: while natural images contain complex visual scenes with objects and backgrounds, the corresponding brain signals reflect focused attention on central objects while being contaminated by various neural noise. Previous methods that directly align visual and brain representations often overlook this inherent asymmetry, resulting in suboptimal decoding performance. To address this, we propose linguistic-prior-guided visual decoupling method, which introducing object-oriented textual descriptions as semantic guidance to explicitly decouple foreground objects from complex backgrounds in natural images, thereby establishing symmetric vision-brain alignment. This design enables the model to automatically focus on task-relevant visual concepts while effectively filtering out irrelevant neural noise in brain signals, achieving a transition from asymmetric feature alignment to semantic symmetric alignment. Extensive experiments on the THINGS-EEG and THINGS-MEG datasets demonstrate that our method achieves new state-of-the-art performance in the zero-shot brain-to-image retrieval task.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f3959709-835d-448e-b5df-936f3ea155f6Builds on8
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Visual Decoding and Reconstruction via EEG Embeddings with Guided DiffusionDongyang Li, Chen Wei, Shiying Li, Jiachen Zou et al.NeurIPS 2024 · 164 citations
- Decoding Natural Images from EEG for Object RecognitionYonghao Song, Bingchuan Liu, Xiang Li, Nanlin Shi et al.ICLR 2024 · 135 citations
- Bridging the Semantic Latent Space between Brain and Machine: Similarity Is All You NeedJiaxuan Chen, Yu Qi, Yueming Wang, Gang PanAAAI 2024 · 13 citations
- Bridging the Vision-Brain Gap with an Uncertainty-Aware Blur PriorHaitao Wu, Qing Li, Changqing Zhang, Zhen He et al.CVPR 2025
Related papers
- ViEEG: Hierarchical Visual Neural Representation for EEG Brain DecodingMinxu Liu, Donghai Guan, Chuhang Zheng, Chunwei Tian et al.ICML 2026 · 2 citations
- Leveraging Visual Blur Perception Characteristics for EEG DecodingWenchao Liu, Hongwei Li, Zhouyang Xu, Lin Ma et al.AAAI 2026
- Learning Brain Representation with Hierarchical Visual EmbeddingsJiawen Zheng, Haonan Jia, MING LI, Yuhui Zheng et al.ICLR 2026 · 3 citations
- HyFI: Hyperbolic Feature Interpolation for Brain-Vision AlignmentSangmin Jo, Wootaek Jeong, Da-Woon Heo, Yoohwan Hwang et al.AAAI 2026 · 2 citations
- NeuroBridge: Bio-Inspired Self-Supervised EEG-to-Image Decoding via Cognitive Priors and Bidirectional Semantic AlignmentWenjiang Zhang, Sifeng Wang, Yuwei Su, Xinyu Li et al.AAAI 2026 · 7 citations
