Fun-ASR Technical Report
About
In recent years, automatic speech recognition (ASR) has witnessed transformative advancements driven by three complementary paradigms: data scaling, model size scaling, and deep integration with large language models (LLMs). However, LLMs are prone to hallucination, which can significantly degrade user experience in real-world ASR applications. In this paper, we present Fun-ASR, a large-scale, LLM-based ASR system that synergistically combines massive data, large model capacity, LLM integration, and reinforcement learning to achieve state-of-the-art performance across diverse and complex speech recognition scenarios. Moreover, Fun-ASR is specifically optimized for practical deployment, with enhancements in streaming capability, noise robustness, code-switching, hotword customization, and satisfying other real-world application requirements. Experimental results show that while most LLM-based ASR systems achieve strong performance on open-source benchmarks, they often underperform on real industry evaluation sets. Thanks to production-oriented optimizations, Fun-ASR achieves state-of-the-art performance on real application datasets, demonstrating its effectiveness and robustness in practical settings. The code and models are accessible at https://github.com/FunAudioLLM/Fun-ASR .
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Automatic Speech Recognition | LibriSpeech clean (test) | WER1.51 | 833 | |
| Automatic Speech Recognition | LibriSpeech Other | WER4.03 | 75 | |
| Automatic Speech Recognition | LibriSpeech Clean | WER1.68 | 57 | |
| Speech Recognition | Fleurs En | WER5.49 | 20 | |
| Automatic Speech Recognition | AISHELL-1 | CER1.22 | 12 | |
| Automatic Speech Recognition | CV-zh | CER6.2 | 7 | |
| Automatic Speech Recognition | Dialog-Accented English | WER0.1996 | 7 | |
| Automatic Speech Recognition | Dialog-Cantonese | WER5.85 | 7 | |
| Automatic Speech Recognition | Dialog-Chinese Dialects | WER0.1941 | 7 | |
| Automatic Speech Recognition | CV en | WER9.9 | 7 |