SOTA Speech-to-speech translation benchmarks and papers with code

Benchmarks

Dataset Name	SOTA Method	Metric
Fisher Spanish-English (test)		BLEU (Speech Input)90.5	55	3mo ago
Fisher Spanish-English (dev)		BLEU (Speech)88.5	48	3mo ago
CVSS-C	Synthetic target	Avg Score0.911	38	3mo ago
Fisher Spanish-English (dev2)	Synthetic target	ASR BLEU89.4	36	3mo ago
CVSS-C DE → EN (test)		ASR-BLEU75.53	16	3mo ago
CVSS-C ES → EN (test)		ASR-BLEU88.54	16	3mo ago
CVSS-C Fr→En		ASR-BLEU84.52	11	16d ago
VoxPopuli En-Fr (test)	Seamless	BLEU Score25	11	3mo ago
VoxPopuli En-Es (test)	Seamless	BLEU29.2	11	3mo ago
VoxPopuli Fr-En (test)	Seamless	BLEU Score35.9	11	3mo ago
VoxPopuli Es-En (test)	Seamless	BLEU34.7	11	3mo ago
CVSS-C Average		ASR-BLEU82.86	10	16d ago
CVSS-C Es→En		ASR-BLEU88.54	10	16d ago
CVSS-C De→En		ASR BLEU75.53	10	16d ago
CVSS-T zh→en	SeamlessM4T-Large-v2	ASR-BLEU23.6	10	1mo ago
CVSS-T en→zh	MoVE	ASR-BLEU32.5	10	1mo ago
Multi-domain Es->En (CoVOST-2, Europarl-ST, mTEDx)	S2TT-TTS (C2')	CoVOST-2 Score37.2	10	3mo ago
Multi-domain En->Es (Europarl-ST, MuST-C)	S2SpecT2 + t-mBART	Score (Europarl-ST)36.9	10	3mo ago
Fisher Es→En (test)	S2SpecT2	ASR chrF70.2	10	3mo ago
Fisher Es→En (dev)	S2SpecT2	ASR chrF69.5	10	3mo ago
Europarl-ST Es->En (test)		ASR-BLEU34.2	10	3mo ago
CoVOST-2 Es->En (test)		ASR-BLEU37.2	10	3mo ago
MuST-C En->Es (test)	S2U-DDM	ASR-BLEU34.5	10	3mo ago
Europarl-ST En->Es (test)	S2Sp-DDM	ASR-BLEU37.2	10	3mo ago
Audio-NTREX-4L long-form (test)	Hibiki-Zero	BLEU33.2	9	3mo ago

Showing 25 of 56 rows