Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Fun-ASR Technical Report

About

In recent years, automatic speech recognition (ASR) has witnessed transformative advancements driven by three complementary paradigms: data scaling, model size scaling, and deep integration with large language models (LLMs). However, LLMs are prone to hallucination, which can significantly degrade user experience in real-world ASR applications. In this paper, we present Fun-ASR, a large-scale, LLM-based ASR system that synergistically combines massive data, large model capacity, LLM integration, and reinforcement learning to achieve state-of-the-art performance across diverse and complex speech recognition scenarios. Moreover, Fun-ASR is specifically optimized for practical deployment, with enhancements in streaming capability, noise robustness, code-switching, hotword customization, and satisfying other real-world application requirements. Experimental results show that while most LLM-based ASR systems achieve strong performance on open-source benchmarks, they often underperform on real industry evaluation sets. Thanks to production-oriented optimizations, Fun-ASR achieves state-of-the-art performance on real application datasets, demonstrating its effectiveness and robustness in practical settings. The code and models are accessible at https://github.com/FunAudioLLM/Fun-ASR .

Keyu An, Yanni Chen, Zhigao Chen, Chong Deng, Zhihao Du, Changfeng Gao, Zhifu Gao, Bo Gong, Xiangang Li, Yabin Li, Ying Liu, Xiang Lv, Yunjie Ji, Yiheng Jiang, Bin Ma, Haoneng Luo, Chongjia Ni, Zexu Pan, Yiping Peng, Zhendong Peng, Peiyao Wang, Hao Wang, Haoxu Wang, Wen Wang, Wupeng Wang, Yuzhong Wu, Biao Tian, Zhentao Tan, Nan Yang, Bin Yuan, Jieping Ye, Jixing Yu, Qinglin Zhang, Kun Zou, Han Zhao, Shengkui Zhao, Jingren Zhou, Yanqiao Zhu• 2025

Related benchmarks

TaskDatasetResultRank
Automatic Speech RecognitionLibriSpeech clean (test)
WER1.51
1207
Automatic Speech RecognitionLibriSpeech (test-other)
WER4.33
1206
Automatic Speech RecognitionLibriSpeech (dev-other)
WER4.06
486
Automatic Speech RecognitionLibriSpeech (dev-clean)
WER (%)1.63
340
Automatic Speech RecognitionLibriSpeech Other
WER4.03
123
Automatic Speech RecognitionLibriSpeech Clean
WER1.68
107
Automatic Speech RecognitionAISHELL-1 (test)
CER1.64
105
Speech RecognitionLibriSpeech clean (dev)
WER0.0163
104
Automatic Speech RecognitionWenetSpeech Meeting (test)
CER6.6
78
Automatic Speech RecognitionWenetSpeech Net (test)
CER6.01
57
Showing 10 of 104 rows
...

Other info

Follow for update