Lune

ACL Findings2023

How does the brain process syntactic structure while listening?

Subba Reddy Oota, Mounika Marreddy, Manish Gupta, Raju S. Bapi

Abstract

Syntactic parsing is the task of assigning a syntactic structure to a sentence. There are two popular syntactic parsing methods: constituency and dependency parsing. Recent works have used syntactic embeddings based on constituency trees, incremental top-down parsing, and other word syntactic features for brain activity prediction given the text stimuli to study how the syntax structure is represented in the brain's language network. However, the effectiveness of dependency parse trees or the relative predictive power of the various syntax parsers across brain areas, especially for the listening task, is yet unexplored. In this study, we investigate the predictive power of the brain encoding models in three settings: (i) individual performance of the constituency and dependency syntactic parsing based embedding methods, (ii) efficacy of these syntactic parsing based embedding methods when controlling for basic syntactic signals, (iii) relative effectiveness of each of the syntactic embedding methods when controlling for the other. Further, we explore the relative importance of syntactic information (from these syntactic embedding methods) versus semantic information using BERT embeddings. We find that constituency parsers help explain activations in the temporal lobe and middle-frontal gyrus, while dependency parsers better encode syntactic structure in the angular gyrus and posterior cingulate cortex. Although semantic signals from BERT are more effective compared to any of the syntactic features or embedding methods, syntactic embedding methods explain additional variance for a few brain regions. We make our code publicly available 1 .

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · 1 top-tier paper that cites it · related work

Get the answer

Free to start. No credit card required.

Cited by top-tier papers1

  1. Multipath parsing in the brainBerta Franzluebbers, Donald Dunagan, Milos Stanojevic, Jan Buys et al.ACL 2024 · 1 citation

Builds on9

  1. Disentangling syntax and semantics in the brain with deep networksCharlotte Caucheteux, Alexandre Gramfort, Jean-Remi KingICML 2021 · 96 citations
  2. Joint processing of linguistic properties in brains and language modelsSubba Reddy Oota, Manish Gupta, Mariya TonevaNeurIPS 2023 · 64 citations
  3. Can fMRI reveal the representation of syntactic structure in the brain?Aniketh Janardhan Reddy, Leila WehbeNeurIPS 2021 · 54 citations
  4. Probing Word Syntactic Representations in the Brain by a Feature Elimination MethodXiaohan Zhang, Shaonan Wang, Nan Lin, Jiajun Zhang et al.AAAI 2022 · 26 citations
  5. Probing Brain Activation Patterns by Dissociating Semantics and Syntax in SentencesShaonan Wang, Jiajun Zhang, Nan Lin, Chengqing ZongAAAI 2020 · 23 citations

Related papers

  1. KERMIT: Complementing Transformer Architectures with Encoders of Explicit Syntactic InterpretationsFabio Massimo Zanzotto, Andrea Santilli, Leonardo Ranaldi, Dario Onorati et al.EMNLP 2020 · 45 citations
  2. Parsing All: Syntax and Semantics, Dependencies and SpansJunru Zhou, Zuchao Li, Hai ZhaoEMNLP Findings 2020 · 35 citations
  3. Transition-based Semantic Dependency Parsing with Pointer NetworksDaniel Fernández-González, Carlos Gómez-RodríguezACL 2020 · 4 citations
  4. Rethinking Self-Attention: Towards Interpretability in Neural ParsingKhalil Mrini, Franck Dernoncourt, Quan Hung Tran, Trung Bui et al.EMNLP Findings 2020 · 124 citations
  5. Challenges to Open-Domain Constituency ParsingSen Yang, Leyang Cui, Ruoxi Ning, Di Wu et al.ACL Findings 2022 · 9 citations
Dusk over the sea between two cliffs drawn in fine vertical lines