Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

BABEL

Benchmarks

Task NameDataset NameSOTA ResultTrend
Action RecognitionBABEL 75% OR
Accuracy58.54
28
Action RecognitionBABEL 50% OR
Accuracy56.97
28
Action RecognitionBABEL 25% OR
Accuracy51.71
28
Action RecognitionBABEL 100% OR
Accuracy59.65
14
Human Motion CompositionBabel
PJ1.09
13
Action LocalizationBABEL Subset-2 v1.0 (test)
mAP@0.165.2
12
Action LocalizationBABEL (test)
mAP@tIoU (Subset-1)53.9
12
Motion GenerationBABEL 2021 (test)
FID0.0004
10
Text-to-Motion RetrievalBABEL
Recall@139.31
9
Action RecognitionBABEL60
Top-1 Accuracy47.41
9
Speech RecognitionBABEL Swahili sw (test)
WER21
7
Speech RecognitionBABEL Tagalog tl (test)
WER29.3
7
Action LocalizationBABEL Subset-3
mAP@0.148.5
6
Action LocalizationBABEL Subset-1
mAP@0.160.5
6
Action LocalizationBABEL Subset-3 v1.0 (test)
mAP@0.142
6
Action LocalizationBABEL Subset-1 v1.0 (test)
mAP@0.153.7
6
Speech RecognitionBABEL Georgian ka (test)
WER24.3
6
Speech RecognitionBABEL Assamese as (test)
WER39
6
Automatic Speech RecognitionBabel Average (test)
Absolute WER Improvement5.77
6
Automatic Speech RecognitionBabel Lithuanian - LIT IARPA program (test)
WER66
6
Automatic Speech RecognitionBabel Telugu - TEL (test)
WER82.4
6
Automatic Speech RecognitionBabel Kazakh - KAZ IARPA program (test)
WER71
6
Automatic Speech RecognitionBabel Cebuano - CEB IARPA program (test)
WER70.6
6
Automatic Speech RecognitionBabel Tok Pisin - TOK IARPA program (test)
WER54.3
6
Automatic Speech RecognitionBabel Kurmanji - KUR IARPA program (test)
WER77.7
6
Showing 25 of 44 rows