Lune

ACL Findings2026

PUMA: Projected Universal Multilingual ASR for Low-Resource Settings. Application to Diverse African Languages

Ilyes Oukid, Bilal Faye, Hanane Azzag, Mustapha Lebbah, Said Yacine Boulahia

Abstract

Multilingual ASR systems often fail to generalize to low-resource and linguistically diverse languages while remaining costly to scale. We introduce PUMA, a unified multilingual ASR model that improves low-resource performance with reduced model complexity. PUMA employs a Universal Language Projection (ULP) module that integrates a learnable language token with acoustic representations, enabling language-aware processing through shared parameters. Experiments on diverse African languages show consistent word error rate reductions over strong multilingual baselines, highlighting improved robustness and generalization. Our code is available at the following GitHub URL: https://github.com/ ilyes-okd/PUMA

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · related work

Get the answer

Free to start. No credit card required.

Builds on4

  1. wav2vec 2.0: A Framework for Self-Supervised Learning of Speech RepresentationsAlexei Baevski, Yuhao Zhou, Abdelrahman Mohamed, Michael AuliNeurIPS 2020 · 9,451 citations
  2. Robust Speech Recognition via Large-Scale Weak SupervisionAlec Radford, Jong Wook Kim, Tao Xu, Greg Brockman et al.ICML 2023 · 6,966 citations
  3. Unsupervised Speech RecognitionAlexei Baevski, Wei-Ning Hsu, Alexis Conneau, Michael AuliNeurIPS 2021 · 309 citations
  4. Master-ASR: Achieving Multilingual Scalability and Low-Resource Adaptation in ASR with Modular LearningZhongzhi Yu, Yang Zhang, Kaizhi Qian, Cheng Wan et al.ICML 2023 · 17 citations

Related papers

  1. LAMA-UT: Language Agnostic Multilingual ASR Through Orthography Unification and Language-Specific TransliterationSangmin Lee, Woo-Jin Chung, Hong-Goo KangAAAI 2025 · 1 citation
  2. Bitext Mining Using Distilled Sentence Representations for Low-Resource LanguagesKevin Heffernan, Onur Çelebi, Holger SchwenkEMNLP Findings 2022 · 47 citations
  3. TURNA: A Turkish Encoder-Decoder Language Model for Enhanced Understanding and GenerationGökçe Uludogan, Zeynep Yirmibesoglu Balal, Salih Furkan Akkurt, Meliksah Türker et al.ACL Findings 2024 · 22 citations
  4. Toucan: Many-to-Many Translation for 150 African Language PairsAbdelRahim A. Elmadany, Ife Adebara, Muhammad Abdul-MageedACL Findings 2024 · 1 citation
  5. Learning Language Specific Sub-network for Multilingual Machine TranslationZehui Lin, Liwei Wu, Mingxuan Wang, Lei LiACL 2021
Dusk over the sea between two cliffs drawn in fine vertical lines