Convex Low-resource Accent-Robust Language Detection in Speech Recognition
Miria Feng, William H. Tan, Mert Pilanci
Abstract
Globalization and multiculturalism continue to produce increasingly diverse speech varieties. Yet current spoken dialogue systems frequently fail on under-represented dialects and accents, often misidentifying the input language and causing cascading failures in downstream dialogue tasks. Addressing this dialectal variance under low-resource constraints remains an open challenge, as standard fine-tuning is computationally expensive and prone to overfitting on high-dimensional speech data. We propose Convex Language Detection (CLD), a novel framework that integrates theoretically grounded convex optimization techniques into the spoken dialogue systems pipeline. Our method is efficiently implemented via multi-GPU Alternating Direction Method of Multipliers (ADMM) in JAX, thus providing global optimality guarantees and fast training in polynomial time. Theoretically, we prove that our convex objective induces certified margin stability and provide guarantees against feature perturbations. Empirically, we demonstrate sample efficiency and robustness to input dialectical variation, achieving 97–98% accuracy in challenging low-resource regimes. Our open-source package is available at https://pypi.org/project/jaxcld/.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext bcdf8c68-7f7d-40b2-aabd-47330c134b4aBuilds on7
- Robust Speech Recognition via Large-Scale Weak SupervisionAlec Radford, Jong Wook Kim, Tao Xu, Greg Brockman et al.ICML 2023 · 6,966 citations
- Neural Networks are Convex Regularizers: Exact Polynomial-time Convex Optimization Formulations for Two-layer NetworksMert Pilanci, Tolga ErgenICML 2020 · 142 citations
- Vector-output ReLU Neural Network Problems are Copositive Programs: Convex Analysis of Two Layer Networks and Polynomial-time AlgorithmsArda Sahiner, Tolga Ergen, John M. Pauly, Mert PilanciICLR 2021 · 45 citations
- Opportunities and Challenges of Automatic Speech Recognition Systems for Low-Resource Language SpeakersThomas Reitmaier, Electra Wallington, Dani Kalarikalayil Raju, Ondrej Klejch et al.CHI 2022 · 44 citations
- Fast Convex Optimization for Two-Layer ReLU Networks: Equivalent Model Classes and Cone DecompositionsAaron Mishkin, Arda Sahiner, Mert PilanciICML 2022 · 35 citations
Related papers
- DialUp! Modeling the Language Continuum by Adapting Models to Dialects and Dialects to ModelsNiyati Bafna, Emily Chang, Nathaniel Romney Robinson, David R. Mortensen et al.ACL 2025
- What Language is This? Ask Your Tokenizer.Clara Meister, Ahmetcan Yavuz, Pietro Lesci, Tiago PimentelICML 2026 · 1 citation
- Multi-Label Intent Detection via Contrastive Task Specialization of Sentence EncodersIvan Vulic, Iñigo Casanueva, Georgios Spithourakis, Avishek Mondal et al.EMNLP 2022 · 6 citations
- CRONOS: Enhancing Deep Learning with Scalable GPU Accelerated Convex Neural NetworksMiria Feng, Zachary Frangella, Mert PilanciNeurIPS 2024 · 6 citations
- NaijaHate: Evaluating Hate Speech Detection on Nigerian Twitter Using Representative DataManuel Tonneau, Pedro Vitor Quinta de Castro, Karim Lasri, Ibrahim Farouq et al.ACL 2024
