Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

UTMOS: UTokyo-SaruLab System for VoiceMOS Challenge 2022

About

We present the UTokyo-SaruLab mean opinion score (MOS) prediction system submitted to VoiceMOS Challenge 2022. The challenge is to predict the MOS values of speech samples collected from previous Blizzard Challenges and Voice Conversion Challenges for two tracks: a main track for in-domain prediction and an out-of-domain (OOD) track for which there is less labeled data from different listening tests. Our system is based on ensemble learning of strong and weak learners. Strong learners incorporate several improvements to the previous fine-tuning models of self-supervised learning (SSL) models, while weak learners use basic machine-learning methods to predict scores from SSL features. In the Challenge, our system had the highest score on several metrics for both the main and OOD tracks. In addition, we conducted ablation studies to investigate the effectiveness of our proposed methods.

Takaaki Saeki, Detai Xin, Wataru Nakata, Tomoki Koriyama, Shinnosuke Takamichi, Hiroshi Saruwatari• 2022

Related benchmarks

TaskDatasetResultRank
Speech Quality AssessmentClean
MOS0.51
18
Speech Quality AssessmentNoisy
MOS0.47
18
Speech Quality AssessmentKids
MOS-0.02
18
Speech Quality AssessmentWild
MOS-0.12
18
Preference EvaluationSOMOS
Acc@0.552
15
Preference EvaluationURGENT SQA 24
Acc@0.555
15
Preference EvaluationSpeechEval
Acc@0.568
15
Preference EvaluationNISQA-P501
Acc@0.572
15
Preference EvaluationNISQA-FOR
Acc@0.567
15
Preference EvaluationCHiME UDASE 7 (test)
Acc@0.549
15
Showing 10 of 42 rows

Other info

Follow for update