ACL Findings2023
How does the brain process syntactic structure while listening?
Subba Reddy Oota, Mounika Marreddy, Manish Gupta, Raju S. Bapi
摘要
Syntactic parsing is the task of assigning a syntactic structure to a sentence. There are two popular syntactic parsing methods: constituency and dependency parsing. Recent works have used syntactic embeddings based on constituency trees, incremental top-down parsing, and other word syntactic features for brain activity prediction given the text stimuli to study how the syntax structure is represented in the brain's language network. However, the effectiveness of dependency parse trees or the relative predictive power of the various syntax parsers across brain areas, especially for the listening task, is yet unexplored. In this study, we investigate the predictive power of the brain encoding models in three settings: (i) individual performance of the constituency and dependency syntactic parsing based embedding methods, (ii) efficacy of these syntactic parsing based embedding methods when controlling for basic syntactic signals, (iii) relative effectiveness of each of the syntactic embedding methods when controlling for the other. Further, we explore the relative importance of syntactic information (from these syntactic embedding methods) versus semantic information using BERT embeddings. We find that constituency parsers help explain activations in the temporal lobe and middle-frontal gyrus, while dependency parsers better encode syntactic structure in the angular gyrus and posterior cingulate cortex. Although semantic signals from BERT are more effective compared to any of the syntactic features or embedding methods, syntactic embedding methods explain additional variance for a few brain regions. We make our code publicly available 1 .
问 Lune
尽管问,回答会引用原文。
Lune 会读完全文和相关的 Paper,每个回答都附上所依据的原文段落。
引用它的顶会 Paper1
它引用的 Paper9
- Disentangling syntax and semantics in the brain with deep networksCharlotte Caucheteux, Alexandre Gramfort, Jean-Remi KingICML 2021 · 96 次引用
- Joint processing of linguistic properties in brains and language modelsSubba Reddy Oota, Manish Gupta, Mariya TonevaNeurIPS 2023 · 64 次引用
- Can fMRI reveal the representation of syntactic structure in the brain?Aniketh Janardhan Reddy, Leila WehbeNeurIPS 2021 · 54 次引用
- Probing Word Syntactic Representations in the Brain by a Feature Elimination MethodXiaohan Zhang, Shaonan Wang, Nan Lin, Jiajun Zhang 等AAAI 2022 · 26 次引用
- Probing Brain Activation Patterns by Dissociating Semantics and Syntax in SentencesShaonan Wang, Jiajun Zhang, Nan Lin, Chengqing ZongAAAI 2020 · 23 次引用
相关 Paper
- KERMIT: Complementing Transformer Architectures with Encoders of Explicit Syntactic InterpretationsFabio Massimo Zanzotto, Andrea Santilli, Leonardo Ranaldi, Dario Onorati 等EMNLP 2020 · 45 次引用
- Parsing All: Syntax and Semantics, Dependencies and SpansJunru Zhou, Zuchao Li, Hai ZhaoEMNLP Findings 2020 · 35 次引用
- Transition-based Semantic Dependency Parsing with Pointer NetworksDaniel Fernández-González, Carlos Gómez-RodríguezACL 2020 · 4 次引用
- Rethinking Self-Attention: Towards Interpretability in Neural ParsingKhalil Mrini, Franck Dernoncourt, Quan Hung Tran, Trung Bui 等EMNLP Findings 2020 · 124 次引用
- Challenges to Open-Domain Constituency ParsingSen Yang, Leyang Cui, Ruoxi Ning, Di Wu 等ACL Findings 2022 · 9 次引用
