Share your thoughts, 1 month free Claude Pro on usSee more

Speech-to-speech translation on CVSS-C + SpeechMatrix FR-EN (test)

22.72BLEU

Audio-LLM filter

Updated 1mo ago

Evaluation Results

Method	Links
Audio-LLM filter 2026.06		22.72
Stage II only 2026.06		22.49
LLM filtering (LLaMA-70B) 2026.06		22.42
LLM filtering (70B) 2026.06		22.32
BLEURT filtering 2026.06		22.09
BLEURT+LLM ablation 2026.06		22.08
BLEURT filtering 2026.06		21.94
Stage II only 2026.06		21.91
BLASER 2.0-QE ablation 2026.06		21.81
BLASER 2.0-QE filtering 2026.06		21.71
Audio Flamingo 3 2026.06		21.53
SNR filtering 2026.06		21.46
Keep 20% SpeechMatrix 2026.06		21.32
Random keep 2026.06		21.27
SNR filtering 2026.06		21.15
MOS filtering 2026.06		21.06
MOS filtering 2026.06		20.72
LLM filtering (LLaMA-8B) 2026.06		19.95
CVSS-C (reproduced) 2026.06		15.93
CVSS-C (FR-EN) 2026.06		15.44