ACL Findings2023
Categorial grammar induction from raw data
Abstract
Grammar induction, the task of learning a set of grammatical rules from raw or minimally labeled text data, can provide clues about what kinds of syntactic structures are learnable without prior knowledge. Recent work (e.g., Kim et al., 2019;Zhu et al., 2020; Jin et al., 2021a) has achieved advances in unsupervised induction of probabilistic context-free grammars (PCFGs). However, categorial grammar induction has received less recent attention, despite allowing inducers to support a larger set of syntactic categories-due to restrictions on how categories can combine-and providing a transparent interface with compositional semantics, opening up possibilities for models that jointly learn form and meaning. Motivated by this, we propose a new model for inducing a basic (Ajdukiewicz, 1935;Bar-Hillel, 1953) categorial grammar. In contrast to earlier categorial grammar induction systems (e.g., Bisk and Hockenmaier, 2012), our model learns from raw data without any part-of-speech information. Experiments on child-directed speech show that our model attains a recall-homogeneity of 0.33 on average, which dramatically increases to 0.59 when a bias toward forward function application is added to the model.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
Lineage
Builds on2
Related papers
- Character-based PCFG Induction for Modeling the Syntactic Acquisition of Morphologically Rich LanguagesLifeng Jin, Byung-Doh Oh, William SchulerEMNLP Findings 2021 · 2 citations
- VLGrammar: Grounded Grammar Induction of Vision and LanguageYining Hong, Qing Li, Song-Chun Zhu, Siyuan HuangICCV 2021 · 28 citations
- Which Word Orders Facilitate Length Generalization in LMs? An Investigation with GCG-Based Artificial LanguagesNadine El-Naggar, Tatsuki Kuribayashi, Ted BriscoeEMNLP 2025
- Leveraging Grammar Induction for Language Understanding and GenerationJushi Kai, Shengyuan Hou, Yusheng Huang, Zhouhan LinEMNLP Findings 2024 · 1 citation
- A Computational Simulation of Language Production in First Language AcquisitionYuan Gao, Weiwei SunEMNLP 2025
