Lune

EMNLP Findings2021

Character-based PCFG Induction for Modeling the Syntactic Acquisition of Morphologically Rich Languages

Lifeng Jin, Byung-Doh Oh, William Schuler

Abstract

Unsupervised PCFG induction models, which build syntactic structures from raw text, can be used to evaluate the extent to which syntactic knowledge can be acquired from distributional information alone. However, many state-of-the-art PCFG induction models are word-based, meaning that they cannot directly inspect functional affixes, which may provide crucial information for syntactic acquisition in child learners. This work first introduces a neural PCFG induction model that allows a clean ablation of the influence of subword information in grammar induction. Experiments on child-directed speech demonstrate first that the incorporation of subword information results in more accurate grammars with categories that word-based induction models have difficulty finding, and second that this effect is amplified in morphologically richer languages that rely on functional affixes to express grammatical relations. A subsequent evaluation on multilingual treebanks shows that the model with subword information achieves state-ofthe-art results on many languages, further supporting a distributional model of syntactic acquisition.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

2 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers2

  1. GFlowNet-EM for Learning Compositional Latent Variable ModelsEdward J. Hu, Nikolay Malkin, Moksh Jain, Katie E. Everett et al.ICML 2023 · 48 citations
  2. Unsupervised Discontinuous Constituency Parsing with Mildly Context-Sensitive GrammarsSonglin Yang, Roger Levy, Yoon KimACL 2023 · 1 citation

Builds on2

  1. Unsupervised Parsing with S-DIORA: Single Tree Encoding for Deep Inside-Outside Recursive AutoencodersAndrew Drozdov, Subendhu Rongali, Yi-Pei Chen, Tim O'Gorman et al.EMNLP 2020 · 27 citations
  2. Recurrent Neural Network Language Models Always Learn English-Like Relative Clause AttachmentForrest Davis, Marten van SchijndelACL 2020 · 15 citations

Related papers

  1. Categorial grammar induction from raw dataChristian Clark, William SchulerACL Findings 2023
  2. Neural Bi-Lexicalized PCFG InductionSonglin Yang, Yanpeng Zhao, Kewei TuACL 2021
  3. Unraveling Syntax: Language Modeling and the Substructure of GrammarsLaura Ying Schulz, Daniel Mitropolsky, Tomaso A PoggioICML 2026 · 5 citations
  4. How to Plant Trees in Language Models: Data and Architectural Effects on the Emergence of Syntactic Inductive BiasesAaron Mueller, Tal LinzenACL 2023 · 9 citations
  5. A Computational Simulation of Language Production in First Language AcquisitionYuan Gao, Weiwei SunEMNLP 2025
Dusk over the sea between two cliffs drawn in fine vertical lines