Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Convex Low-resource Accent-Robust Language Detection in Speech Recognition

About

Globalization and multiculturalism continue to produce increasingly diverse speech varieties. Yet current spoken dialogue systems frequently fail on under-represented dialects and accents, often misidentifying the input language and causing cascading failures in downstream dialogue tasks. Addressing this dialectal variance under low-resource constraints remains an open challenge, as standard fine-tuning is computationally expensive and prone to overfitting on high-dimensional speech data. We propose Convex Language Detection (CLD), a novel framework that integrates theoretically grounded convex optimization techniques into the spoken dialogue systems pipeline. Our method is efficiently implemented via multi-GPU Alternating Direction Method of Multipliers (ADMM) in JAX, thus providing global optimality guarantees and fast training in polynomial time. Theoretically, we prove that our convex objective induces certified margin stability and provide guarantees against feature perturbations. Empirically, we demonstrate sample efficiency and robustness to input dialectical variation, achieving 97-98% accuracy in challenging low-resource regimes. Our open-source package is available at https://pypi.org/project/jaxcld/

Miria Feng, William Tan, Mert Pilanci• 2026

Related benchmarks

TaskDatasetResultRank
Automatic Speech RecognitionLow-resource Dialectal Speech 5 languages (test)
WER28.6
18
Language IdentificationLow-resource Dialectal Speech 5 languages (test)
Detection Accuracy98.06
18
Multi-dialect classificationEnglish and Chinese Dialects 10 accents
Correct Predictions Count1.82e+3
4
Showing 3 of 3 rows

Other info

GitHub

Follow for update