Share your thoughts, 1 month free Claude Pro on usSee more

Automatic Speech Recognition on LRS3 (test)

0.79WER (%)

Llama-AVSR

Updated 1mo ago

Evaluation Results

Method
Llama-AVSR 2024.09	0.79	-	-	-	-	-
Llama-AVSR 2025.08	0.79	-	-	-	-	-
Ours 2025.08	0.79	-	-	-	-	-
auto-avsr 2024.09	1	-	-	-	-	-
auto-avsr 2024.09	1	-	-	-	-	-
Auto-AVSR 2025.08	1	-	-	-	-	-
Auto-AVSR 2025.08	1	-	-	-	-	-
BRAVEn 2024.09	1.1	-	-	-	-	-
Llama-AVSR 2024.09	1.1	-	-	-	-	-
Llama-AVSR 2025.08	1.1	-	-	-	-	-
USR 2025.08	1.2	-	-	-	-	-
BRAVEn 2025.08	1.2	-	-	-	-	-
AV-HuBERT (A/MFCC→AV) 2022.01	1.3	-	-	-	-	-
AV-HUBERT 2024.09	1.3	-	-	-	-	-
AV-HuBERT 2025.08	1.3	-	-	-	-	-
RAVEn 2024.09	1.4	-	-	-	-	-
Llama-AVSR 2024.09	1.4	-	-	-	-	-
RAVEn 2025.08	1.4	-	-	-	-	-
RAVEn 2025.08	1.4	-	-	-	-	-
Hsu et al. (2021a) (A/MFCC→A) 2022.01	1.5	-	-	-	-	-
Llama-AVSR 2024.09	1.5	-	-	-	-	-
u-HuBERT 2025.08	1.5	-	-	-	-	-
Fast Conformer 2024.09	1.6	-	-	-	-	-
BRAVEn 2024.09	1.7	-	-	-	-	-
RAVEn 2024.09	1.9	-	-	-	-	-
AV-HuBERT (A/MFCC→AV) 2022.01	2	-	-	-	-	-
DistillAV 2025.02	2.2	-	-	-	-	-
Ma et al. (2021b) 2022.01	2.3	-	-	-	-	-
CM-seq2seq 2024.09	2.3	-	-	-	-	-
Whisper-finetuned 2024.09	2.3	-	-	-	-	-
Hsu et al. (2021a) (A/MFCC→A) 2022.01	2.4	-	-	-	-	-
DistillAV 2025.02	2.4	-	-	-	-	-
DistillAV 2025.02	2.5	-	-	-	-	-
RAVen 2025.02	2.6	-	-	-	-	-
AV-data2vec 2025.02	2.7	-	-	-	-	-
AV-HuBERT (A/MFCC→AV) 2022.01	2.9	-	-	-	-	-
AV-HuBERT 2025.02	2.9	-	-	-	-	-
DistillAV 2025.02	3	-	-	-	-	-
Hsu et al. (2021a) (A/MFCC→A) 2022.01	3.2	-	-	-	-	-
AV-data2vec 2025.02	3.7	-	-	-	-	-
AV-data2vec 2025.02	3.7	-	-	-	-	-
AV-HuBERT (A/MFCC→AV) 2022.01	3.8	-	-	-	-	-
RAVen 2025.02	3.8	-	-	-	-	-
AV-HuBERT (A/MFCC→AV) 2022.01	4.2	-	-	-	-	-
AV-data2vec 2025.02	4.4	-	-	-	-	-
Hsu et al. (2021a) (A/MFCC→A) 2022.01	4.5	-	-	-	-	-
AV-HuBERT 2025.02	4.5	-	-	-	-	-
AV-HuBERT 2025.02	4.6	-	-	-	-	-
RAVen 2025.02	4.7	-	-	-	-	-
RNN-T 2025.08	4.8	-	-	-	-	-
AV-HuBERT (A/MFCC→AV) 2022.01	4.9	-	-	-	-	-
AV-HuBERT 2025.02	4.9	-	-	-	-	-
Hsu et al. (2021a) (A/MFCC→A) 2022.01	5	-	-	-	-	-
Hsu et al. (2021a) (A/MFCC→A) 2022.01	5.4	-	-	-	-	-
AV2vec-MLM 2025.02	5.6	-	-	-	-	-
Xu et al. (2020) 2022.01	7.2	-	-	-	-	-
Afouras et al. (2018a) 2022.01	8.3	-	-	-	-	-
Afouras et al. (2018a) 2022.01	8.9	-	-	-	-	-
Ma et al. 2022.07	-	2.3	-	-	-	-
Ma et al. 2022.07	-	-	2.3	-	-	-
Ma et al. 2022.07	-	-	-	43.3	-	-
Xu et al. 2022.07	-	6.8	-	-	-	-
Ma et al. 2022.07	-	-	-	31.5	-	-
Afouras et al. 2022.07	-	-	-	30.7	-	-
Makino et al. 2022.07	-	4.5	-	-	-	-
Makino et al. 2022.07	-	-	4.8	-	-	-
Makino et al. 2022.07	-	-	-	33.6	-	-
Serdyuk et al. 2022.07	-	-	-	25.9	-	-
Serdyuk et al. 2022.07	-	2.3	-	-	-	-
Shi et al. 2022.07	-	1.4	-	-	-	-
Shi et al. 2022.07	-	-	1.6	-	-	-
Shi et al. 2022.07	-	-	-	28.6	-	-
Afouras et al. 2022.07	-	-	-	59.8	-	-
u-HuBERT 2022.07	-	1.3	1.5	29.1	-	-
u-HuBERT 2022.07	-	1.3	1.4	31.6	-	-
u-HuBERT 2022.07	-	2.1	5.1	28.7	-	-
u-HuBERT 2022.07	-	1.2	1.4	27.2	-	-
CM-seq2seq 2023.03	-	-	-	-	2.3	-
RNN-T 2023.03	-	-	-	-	4.5	-
AV-HUBERT 2023.03	-	-	-	-	1.3	-
AUTO-AVSR 2023.03	-	-	-	-	1.5	-
AUTO-AVSR 2023.03	-	-	-	-	1	-
AUTO-AVSR 2023.03	-	-	-	-	1	-
Makino et al. 2025.10	-	-	-	-	4.8	-
Auto-AVSR 2025.10	-	-	-	-	1	-
Auto-AVSR 2025.10	-	-	-	-	1	-
AV-HuBERT-L 2025.10	-	-	-	-	2.7	-
BRAVEn-B 2025.10	-	-	-	-	1.9	-
AV-data2vec-B 2025.10	-	-	-	-	2	-
AV2vec-MLM 2025.10	-	-	-	-	2.7	-
USR 2025.10	-	-	-	-	1.9	-
DistillAV-B 2025.10	-	-	-	-	1.9	44.8
DistillAV-L 2025.10	-	-	-	-	1.8	41.8
UASR-LLM-B 2025.10	-	-	-	-	1.1	38.1
UASR-LLM-L 2025.10	-	-	-	-	0.96	36.8
AV-HuBERT-L 2025.10	-	-	-	-	1.3	-
BRAVEn-L 2025.10	-	-	-	-	1.2	-
AV-data2vec-B 2025.10	-	-	-	-	1.7	-
AV-data2vec-L 2025.10	-	-	-	-	1.4	-
USR-B 2025.10	-	-	-	-	1.6	-

Showing 100 of 123 rows