Algorithms for Weighted Pushdown Automata
Alexandra Butoi, Brian DuSell, Tim Vieira, Ryan Cotterell, David Chiang
Abstract
Weighted pushdown automata (WPDAs) are at the core of many natural language processing tasks, like syntax-based statistical machine translation and transition-based dependency parsing. As most existing dynamic programming algorithms are designed for context-free grammars (CFGs), algorithms for PDAs often resort to a PDA-to-CFG conversion. In this paper, we develop novel algorithms that operate directly on WPDAs. Our algorithms are inspired by Lang’s algorithm, but use a more general definition of pushdown automaton and either reduce the space requirements by a factor of |Gamma| (the size of the stack alphabet) or reduce the runtime by a factor of more than |Q| (the number of states). When run on the same class of PDAs as Lang’s algorithm, our algorithm is both more space-efficient by a factor of |Gamma| and more time-efficient by a factor of |Q| x |Gamma|.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext b1b1571b-651e-437a-8310-2955f466bd85Cited by top-tier papers4
- Exact Recursive Probabilistic ProgrammingDavid Chiang, Colin McDonald, Chung-chieh ShanOOPSLA 2023 · 12 citations
- On Parsing as TaggingAfra Amini, Ryan CotterellEMNLP 2022 · 1 citation
- Efficient Algorithms for Recognizing Weighted Tree-Adjoining LanguagesAlexandra Butoi, Tim Vieira, Ryan Cotterell, David ChiangEMNLP 2023
- The Surprising Computational Power of Nondeterministic Stack RNNsBrian DuSell, David ChiangICLR 2023
Builds on1
Related papers
- Stack Attention: Improving the Ability of Transformers to Model Hierarchical PatternsBrian DuSell, David ChiangICLR 2024 · 15 citations
- Faster general parsing through context-free memoizationGrzegorz HermanPLDI 2020 · 4 citations
- Pre³: Enabling Deterministic Pushdown Automata for Faster Structured LLM GenerationJunyi Chen, Shihao Bai, Zaijun Wang, Siyu Wu et al.ACL 2025
- Good-for-games ω-Pushdown AutomataKaroliina Lehtinen, Martin ZimmermannLICS 2020 · 7 citations
- Algorithms for Acyclic Weighted Finite-State Automata with Failure ArcsAnej Svete, Benjamin Dayan, Ryan Cotterell, Tim Vieira et al.EMNLP 2022 · 2 citations
