Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

UTMOS: UTokyo-SaruLab System for VoiceMOS Challenge 2022

About

We present the UTokyo-SaruLab mean opinion score (MOS) prediction system submitted to VoiceMOS Challenge 2022. The challenge is to predict the MOS values of speech samples collected from previous Blizzard Challenges and Voice Conversion Challenges for two tracks: a main track for in-domain prediction and an out-of-domain (OOD) track for which there is less labeled data from different listening tests. Our system is based on ensemble learning of strong and weak learners. Strong learners incorporate several improvements to the previous fine-tuning models of self-supervised learning (SSL) models, while weak learners use basic machine-learning methods to predict scores from SSL features. In the Challenge, our system had the highest score on several metrics for both the main and OOD tracks. In addition, we conducted ablation studies to investigate the effectiveness of our proposed methods.

Takaaki Saeki, Detai Xin, Wataru Nakata, Tomoki Koriyama, Shinnosuke Takamichi, Hiroshi Saruwatari• 2022

Related benchmarks

TaskDatasetResultRank
Preference EvaluationSOMOS
Acc@0.552
15
Preference EvaluationURGENT SQA 24
Acc@0.555
15
Preference EvaluationSpeechEval
Acc@0.568
15
Preference EvaluationNISQA-P501
Acc@0.572
15
Preference EvaluationNISQA-FOR
Acc@0.567
15
Preference EvaluationCHiME UDASE 7 (test)
Acc@0.549
15
Preference EvaluationSpeechJudge
Acc@0.523
15
Preference EvaluationURGENT25-SQA
Acc@0.550
15
Preference EvaluationTMHINT-QI
Acc@0.546
15
Speech Quality AssessmentBVCC
LCC0.88
12
Showing 10 of 31 rows

Other info

Follow for update