Our new X account is live! Follow @wizwand_team for updates

Speech-to-speech translation on Fisher Spanish-English (dev2)

89.4ASR BLEU

Synthetic target

Updated 4d ago

Evaluation Results

Method
Synthetic target 2022.12	89.4	-	-	-	-	-
S2Sp-DDM, w2v2 2023.05	59.8	-	-	-	-	-
S2Sp-Tn2+, C-w2v2 2023.05	59.5	-	-	-	-	-
S2SpecT2 2022.12	59.5	-	-	-	-	-
S2U-DDM, w2v2 2023.05	58	-	-	-	-	-
UnitY, C-w2v2 2023.05	56.5	-	-	-	-	-
UnitY 2022.12	56.5	-	-	-	-	-
S2Sp-DDM 2023.05	55.1	-	-	-	-	-
S2U, C-w2v2 2023.05	53.9	-	-	-	-	-
S2UT 2022.12	53.9	-	-	-	-	-
S2U-DDM 2023.05	53.6	-	-	-	-	-
S2TT-TTS, C-w2v2 2023.05	52.2	-	-	-	-	-
S2TT -> TTS 2022.12	52.2	-	-	-	-	-
S2U-RDC, w2v2 2023.05	52.1	-	-	-	-	-
UnitY, C 2023.05	51.6	-	-	-	-	-
UnitY 2022.12	51.6	-	-	-	-	-
S2Sp-RDC, w2v2 2023.05	51.5	-	-	-	-	-
S2Sp-Tn2+, C 2023.05	51.1	-	-	-	-	-
S2SpecT2 2022.12	51.1	-	-	-	-	-
S2U-RDC 2023.05	49	-	-	-	-	-
S2TT-TTS, C 2023.05	48.9	-	-	-	-	-
S2TT -> TTS 2022.12	48.9	-	-	-	-	-
S2Sp-Tn, C-w2v2 2023.05	47.6	-	-	-	-	-
S2U, C 2023.05	47.6	-	-	-	-	-
S2SpecT 2022.12	47.6	-	-	-	-	-
S2UT 2022.12	47.6	-	-	-	-	-
S2SP-RDC 2023.05	47.3	-	-	-	-	-
S2TT -> TTS 2022.12	45.4	-	-	-	-	-
S2Sp-Tn, C 2023.05	44.4	-	-	-	-	-
S2SpecT 2022.12	44.4	-	-	-	-	-
ASR-MT-TTS 2023.05	43.5	-	-	-	-	-
ASR -> MT -> TTS 2022.12	43.5	-	-	-	-	-
S2SpecT 2022.12	43.3	-	-	-	-	-
ASR -> MT -> TTS 2022.12	41.2	-	-	-	-	-
S2TT -> TTS 2022.12	39.9	-	-	-	-	-
Direct speech-to-spectrogram systems 2022.12	31.5	-	-	-	-	-
Synthetic target 2021.07	-	89.4	100	-	-	-
ASR + MT + TTS 2021.07	-	43.5	46.1	-	-	-
S2T + TTS 2021.07	-	39.9	42.4	-	-	-
Transformer Translatotron 2021.07	-	26.3	-	-	-	-
Transformer Translatotron 2021.07	-	34.1	-	-	-	-
S2UT 2021.07	-	34.6	-	-	-	-
S2UT stacked 2021.07	-	34.5	-	-	-	-
S2UT stacked + CTC 2021.07	-	36.4	37.9	-	-	-
S2UT reduced + CTC 2021.07	-	38.4	41.5	-	-	-
S2UT reduced + CTC 2021.07	-	39.5	42.2	-	-	-
Translatotron 2021.07	-	26.5	-	-	-	-
Translatotron + pre-trained encoder 2021.07	-	31.5	-	-	-	-
ASR + T2ST 2021.07	-	-	-	25.5	-	-
ASR + T2UT reduced 2021.07	-	-	-	40.6	-	-
S2UT reduced 2021.07	-	-	-	35.4	-	-
Translatotron 2021.07	-	-	-	8	-	-
S2UT reduced 2021.07	-	-	-	8	-	-
S2UT reduced 2021.07	-	-	-	32.2	-	-
Translatotron 2021.07	-	-	-	0.6	-	-
Transformer (MT Baseline) 2023.05	-	-	-	65.2	-	-
Transformer + Seq-KD 2023.05	-	-	-	51.4	-	-
Conformer + Seq-KD 2023.05	-	-	-	55.4	-	-
Transformer + MTL + ASR init. 2023.05	-	-	-	49.17	-	-
CTC-Aug ST 2023.05	-	-	-	54.07	1	-
CTC-Aug ST + Seq-KD 2023.05	-	-	-	55.88	1	-
Conformer - CTC 2023.05	-	-	-	51.6	11.8	-
Orthros - CTC 2023.05	-	-	-	54.8	1.09	-
Orthros - CMLM 2023.05	-	-	-	52.2	2.7	-
Transformer - CTC 2023.05	-	-	-	43.91	28.9	-
CTC + MTL 2023.05	-	-	-	45.23	28.9	-
Mask - CTC 2023.05	-	-	-	51.7	-	-
Intermediate CTC 2023.05	-	-	-	51.4	-	-
Self-conditioned CTC 2023.05	-	-	-	51.2	-	-
CTC-NAST 2023.05	-	-	-	55.92	4.1	-
S2TT + TTS 2022.12	-	-	-	-	-	65.2
S2TT + TTS 2022.12	-	-	-	-	-	68.4
S2SpecT 2022.12	-	-	-	-	-	62.1
S2SpecT 2022.12	-	-	-	-	-	65.5
S2SpecT2 2022.12	-	-	-	-	-	66.1
S2SpecT2 2022.12	-	-	-	-	-	70.8
S2UT 2022.12	-	-	-	-	-	64.2
S2UT 2022.12	-	-	-	-	-	68.8
UnitY 2022.12	-	-	-	-	-	65.8
UnitY 2022.12	-	-	-	-	-	69.2