ACL Findings2026
What Do Neural Speech Models Know About Phonology? Evidence from Structured Phoneme Confusions
Eli Stafford, Aimée Lahaussois, Guillaume Wisniewski
Abstract
ASR errors are typically analysed at the phoneme level, treating phonemes as atomic symbols. In this work, we instead adopt a featural representation of phonemes, grounded in phonological theory, which models speech sounds as structured bundles of distinctive articulatory and acoustic properties. This perspective allows us to analyse recognition errors at a finer granularity and to investigate whether certain phonological features are more vulnerable than others. Across multiple languages, we show that phoneme confusions are strongly structured in phonological feature space: errors are predominantly local and exhibit systematic asymmetries that reveal a small set of weakly modelled features. These findings have direct implications both for the design and diagnosis of ASR systems and for cognitive models of human speech perception, where similar featurelevel asymmetries have long been observed.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
Lineage
Builds on1
Related papers
- Language Complexity and Speech Recognition Accuracy: Orthographic Complexity Hurts, Phonological Complexity Doesn'tChihiro Taguchi, David ChiangACL 2024
- Using Phoneme Representations to Build Predictive Models Robust to ASR ErrorsAnjie Fang, Simone Filice, Nut Limsopatham, Oleg RokhlenkoSIGIR 2020 · 16 citations
- Beyond WER: Probing Whisper's Sub-token Decoder Across Diverse Language Resource LevelsSiyu Liang, Nicolas Ballier, Gina-Anne Levow, Richard A. WrightEMNLP 2025
- Probing Subphonemes in Morphology ModelsGal Astrach, Yuval PinterACL Findings 2025
- Hard to Be Heard: Phoneme-Level ASR Analysis of Phonologically Complex, Low-Resource Endangered LanguagesV. S. D. S. Mahesh Akavarapu, Michael Daniel, Gerhard JägerACL Findings 2026
