Speech Translation

Benchmarks

Dataset Name	SOTA Method	Metric
CoVoST-2 (test)	Ground-truth Transcription + mBART-50	Avg BLEU (15 Dir)38	46	4d ago
MuST-C EN-DE (test-COMMON)		BLEU31.7	41	4d ago
MuST-C (test)	contr-cos-all + asr	BLEU Score31.54	29	4d ago
MuST-C (tst-COMMON)	ZEROSWOT-LARGE	BLEU (De)31.2	20	4d ago
CoVoST-2 X-En (test)	AudioPaLM2	Fr Performance44.8	20	4d ago
MuST-C En-De (test)	PDS-Base-8	SacreBLEU28.7	18	4d ago
Callhome En-Es (test)		BLEU31.58	17	4d ago
MuST-C EN-FR COMMON (test)	JT Proposed	BLEU37.4	17	4d ago
Must-C	contr-cos-all + asr + giga	BLEU31.54	15	4d ago
FLEURS (test)	Speech-charSONAR-75 - DUAL	COMET (Low)0.853	15	4d ago
Callhome En-Es (devtest)		BLEU Score32.21	15	4d ago
MuST-C en-de (dev)	AIPA	BLEU26.92	14	4d ago
MuST-C EN-ES (tst-COMMON)	JT Proposed	BLEU31	14	4d ago
libri-trans (test)	End-to-end (w2v2-mBART)	Detokenized BLEU (case-sensitive)23.1	14	4d ago
CoVoST2 ja→en	Qwen2.5-Omni + SICL-AT2	BLEU26.46	13	4d ago
CoVoST2 en→ja	Qwen2.5-Omni + SICL-AT2	BLEU47.57	13	4d ago
MuST-C COMMON (tst)	Multilingual one-to-many (single model)	WER (de)16.5	13	4d ago
CoVoST2 en-zh (test)	Seamless ST	COMET Score82	12	4d ago
CoVoST2 en-de (test)	Seamless ST	COMET Score83	12	4d ago
EuroParl en-it (test)	Transcripts + EuroLLM 9B	COMET Score86	12	4d ago
EuroParl en-de (test)		COMET Score84	12	4d ago
EuroParl en-fr (test)	Transcripts + EuroLLM 9B	COMET Score85	12	4d ago
EuroParl en-es (test)	Transcripts + EuroLLM 9B	COMET85.9	12	4d ago
FLEURS X→En (test)	GenTranslate	BLEU (Average)34	12	4d ago
MuST-C COMMON (test)	CRESS	BLEU29.4	12	4d ago

Showing 25 of 62 rows