Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Polyglot-Lion: Efficient Multilingual ASR for Singapore via Balanced Fine-Tuning of Qwen3-ASR

About

We present Polyglot-Lion, a family of compact multilingual automatic speech recognition (ASR) models tailored for the linguistic landscape of Singapore, covering English, Mandarin, Tamil, and Malay. Our models are obtained by fine-tuning Qwen3-ASR-0.6B and Qwen3-ASR-1.7B exclusively on publicly available speech corpora, using a balanced sampling strategy that equalizes the number of training utterances per language and deliberately omits language-tag conditioning so that the model learns to identify languages implicitly from audio. On 12 benchmarks spanning the four target languages, Polyglot-Lion-1.7B achieves an average error rate of 14.85, competitive with MERaLiON-2-10B-ASR (14.32) - a model 6x larger - while incurring a training cost of \$81 on a single RTX PRO 6000 GPU compared to \$18,862 for the 128-GPU baseline. Inference throughput is approximately 20x faster than MERaLiON at 0.10 s/sample versus 2.02 s/sample. These results demonstrate that linguistically balanced fine-tuning of moderate-scale pretrained models can yield deployment-ready multilingual ASR at a fraction of the cost of larger specialist systems.

Quy-Anh Dang, Chris Ngo• 2026

Related benchmarks

TaskDatasetResultRank
Automatic Speech RecognitionAISHELL-1
CER1.45
50
Automatic Speech RecognitionLibriSpeech
WER0.021
24
Automatic Speech Recognitionfleurs Tamil
WER37.28
17
Automatic Speech RecognitionCommon Voice Mandarin
CER4.91
9
Automatic Speech RecognitionAISHELL Mandarin 3
CER1.86
9
Automatic Speech RecognitionFleurs Mandarin
CER8
9
Automatic Speech RecognitionMesolitica Malay
Word Error Rate (WER)21.51
9
Automatic Speech RecognitionNational Speech Corpus (NSC) English
WER5.28
9
Automatic Speech RecognitionCommon Voice Tamil
WER39.19
9
Automatic Speech RecognitionSLR65 Tamil
WER19.75
9
Showing 10 of 12 rows

Other info

GitHub

Follow for update