Phonotomizer: A Compact, Unsupervised, Online Training Approach to Real-Time, Multilingual Phonetic Segmentation
Michael S. Yantosca, Albert M. K. Cheng
Abstract
Phonetic transcription requires significant time and expert training. Automated, state-of-theart text-dependent methods still involve substantial pre-training annotation labor and may not generalize to multiple languages. Hallucination of speech amid silence or non-speech noise can also plague these methods, which fall short in real-time applications due to post hoc whole-phrase evaluation. This paper introduces Phonotomizer, a compact, unsupervised, online training approach to automatic, multilingual phonetic segmentation, a critical first stage in transcription. Unlike prior approaches, Phonotomizer trains on raw sound files alone and can modulate computational exactness. Preliminary evaluations on Irish and Twi, two underrepresented languages, exhibit segmentation comparable to current forced alignment technology, reducing acoustic model size and minimizing training epochs.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext da186b29-8e48-4e9c-bd18-2550b7beb514Builds on4
- wav2vec 2.0: A Framework for Self-Supervised Learning of Speech RepresentationsAlexei Baevski, Yuhao Zhou, Abdelrahman Mohamed, Michael AuliNeurIPS 2020 · 9,451 citations
- Robust Speech Recognition via Large-Scale Weak SupervisionAlec Radford, Jong Wook Kim, Tao Xu, Greg Brockman et al.ICML 2023 · 6,966 citations
- Language Complexity and Speech Recognition Accuracy: Orthographic Complexity Hurts, Phonological Complexity Doesn'tChihiro Taguchi, David ChiangACL 2024
- Beyond Orthography: Automatic Recovery of Short Vowels and Dialectal Sounds in ArabicYassine El Kheir, Hamdy Mubarak, Ahmed Ali, Shammur Absar ChowdhuryACL 2024
Related papers
- Towards Zero-Shot Learning for Automatic Phonemic TranscriptionXinjian Li, Siddharth Dalmia, David R. Mortensen, Juncheng Li et al.AAAI 2020 · 34 citations
- LAMA-UT: Language Agnostic Multilingual ASR Through Orthography Unification and Language-Specific TransliterationSangmin Lee, Woo-Jin Chung, Hong-Goo KangAAAI 2025 · 1 citation
- Phonemes to the Rescue: Multilingual Tokenization Based on International Phonetic AlphabetMilan Miletic, Julie Kallini, Ekaterina ShutovaACL 2026
- Unsupervised Speech RecognitionAlexei Baevski, Wei-Ning Hsu, Alexis Conneau, Michael AuliNeurIPS 2021 · 309 citations
- REBORN: Reinforcement-Learned Boundary Segmentation with Iterative Training for Unsupervised ASRLiang-Hsuan Tseng, En-Pei Hu, Cheng-Han Chiang, Yuan Tseng et al.NeurIPS 2024 · 5 citations
