Probing Word Syntactic Representations in the Brain by a Feature Elimination Method
Xiaohan Zhang, Shaonan Wang, Nan Lin, Jiajun Zhang, Chengqing Zong
Abstract
Neuroimaging studies have identified multiple brain regions that are associated with semantic and syntactic processing when comprehending language. However, existing methods cannot explore the neural correlates of fine-grained word syntactic features, such as part-of-speech and dependency relations. This paper proposes an alternative framework to study how different word syntactic features are represented in the brain. To separate each syntactic feature, we propose a feature elimination method, called Mean Vector Null space Projection (MVNP). This method can remove a specific feature from word representations, resulting in one-feature-removed representations. Then we respectively associate one-feature-removed and the original word vectors with brain imaging data to explore how the brain represents the removed feature. This paper for the first time studies the cortical representations of multiple fine-grained syntactic features simultaneously and suggests some possible contributions of several brain regions to the complex division of syntactic processing. These findings indicate that the brain foundations of syntactic information processing might be broader than those suggested by classical studies.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers3
- Different types of syntactic agreement recruit the same units within large language modelsDaria Kryvosheieva, Andrea Gregor de Varda, Evelina Fedorenko, Greta TuckuteACL 2026 · 3 citations
- Better Hit the Nail on the Head than Beat around the Bush: Removing Protected Attributes with a Single ProjectionPantea Haghighatkhah, Antske Fokkens, Pia Sommerauer, Bettina Speckmann et al.EMNLP 2022 · 2 citations
- BrainMAP: Learning Multiple Activation Pathways in Brain NetworksSong Wang, Zhenyu Lei, Zhen Tan, Jiaqi Ding et al.AAAI 2025 · 2 citations
Builds on3
- Interpretable multi-timescale models for predicting fMRI responses to continuous natural speechShailee Jain, Vy A. Vo, Shivangi Mahto, Amanda LeBel et al.NeurIPS 2020 · 58 citations
- Null It Out: Guarding Protected Attributes by Iterative Nullspace ProjectionShauli Ravfogel, Yanai Elazar, Hila Gonen, Michael Twiton et al.ACL 2020 · 25 citations
- Probing Brain Activation Patterns by Dissociating Semantics and Syntax in SentencesShaonan Wang, Jiajun Zhang, Nan Lin, Chengqing ZongAAAI 2020 · 23 citations
Related papers
- Can fMRI reveal the representation of syntactic structure in the brain?Aniketh Janardhan Reddy, Leila WehbeNeurIPS 2021 · 54 citations
- Disentangling syntax and semantics in the brain with deep networksCharlotte Caucheteux, Alexandre Gramfort, Jean-Remi KingICML 2021 · 96 citations
- Modeling Task Effects on Meaning Representation in the Brain via Zero-Shot MEG PredictionMariya Toneva, Otilia Stretcu, Barnabás Póczos, Leila Wehbe et al.NeurIPS 2020 · 21 citations
- Multidirectional Associative Optimization of Function-Specific Word RepresentationsDaniela Gerz, Ivan Vulic, Marek Rei, Roi Reichart et al.ACL 2020
- Multipath parsing in the brainBerta Franzluebbers, Donald Dunagan, Milos Stanojevic, Jan Buys et al.ACL 2024 · 1 citation
