Holographic CCG Parsing
Ryosuke Yamaki, Tadahiro Taniguchi, Daichi Mochihashi
Abstract
We propose a method for formulating CCG as a recursive composition in a continuous vector space. Recent CCG supertagging and parsing models generally demonstrate high performance, yet rely on black-box neural architectures to implicitly model phrase structure dependencies. Instead, we leverage the method of holographic embeddings (Nickel et al., 2016) as a compositional operator to explicitly model the dependencies between words and phrase structures in the embedding space. Experimental results revealed that holographic composition effectively improves the supertagging accuracy to achieve state-of-the-art parsing performance when using a C&C parser. The proposed span-based parsing algorithm using holographic composition achieves performance comparable to state-of-the-art neural parsing with Transformers. Furthermore, our model can semantically and syntactically infill text at the phrase level due to the decomposability of holographic composition.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 34ef3286-4f3b-481f-bef5-f86e34bca018Cited by top-tier papers2
- A Walsh Hadamard Derived Linear Vector Symbolic ArchitectureMohammad Mahmudul Alam, Alexander Oberle, Edward Raff, Stella Biderman et al.NeurIPS 2024 · 10 citations
- Speaking Your Language: Spatial Relationships in Interpretable Emergent CommunicationOlaf Lipinski, Adam J. Sobey, Federico Cerutti, Timothy J. NormanNeurIPS 2024 · 5 citations
Builds on5
- BoxE: A Box Embedding Model for Knowledge Base CompletionRalph Abboud, Ismail Ilkan Ceylan, Thomas Lukasiewicz, Tommaso SalvatoriNeurIPS 2020 · 245 citations
- KERMIT: Complementing Transformer Architectures with Encoders of Explicit Syntactic InterpretationsFabio Massimo Zanzotto, Andrea Santilli, Leonardo Ranaldi, Dario Onorati et al.EMNLP 2020 · 45 citations
- Learning with Holographic Reduced RepresentationsAshwinkumar Ganesan, Hang Gao, Sunil Gandhi, Edward Raff et al.NeurIPS 2021 · 37 citations
- Max-Margin Incremental CCG ParsingMilos Stanojevic, Mark SteedmanACL 2020 · 18 citations
- Generating CCG CategoriesYufang Liu, Tao Ji, Yuanbin Wu, Man LanAAAI 2021 · 5 citations
Related papers
- Structural generalization in COGS: Supertagging is (almost) all you needAlban Petit, Caio F. Corro, François YvonEMNLP 2023
- Span-based Semantic Parsing for Compositional GeneralizationJonathan Herzig, Jonathan BerantACL 2021
- Augmenting Transformers with Recursively Composed Multi-grained RepresentationsXiang Hu, Qingyang Zhu, Kewei Tu, Wei WuICLR 2024 · 6 citations
- Revisiting Supertagging for faster HPSG parsingOlga Zamaraeva, Carlos Gómez-RodríguezEMNLP 2024
- Dynamic Head Selection for Neural Lexicalized Constituency ParsingYang Hou, Zhenghua LiACL 2025
