Belebele
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Cross-lingual Alignment Correlation | Belebele FLORES (test) | Pearson Correlation0.9796 | 81 | |
| Cross-lingual Information Retrieval | Belebele | Comp@100.9322 | 80 | |
| Hallucination Detection | Belebele | Mean AUROC0.7719 | 48 | |
| Reading Comprehension | Belebele | Accuracy84.7 | 39 | |
| Reading Comprehension | Belebele 28 European languages | Overall Score85.91 | 34 | |
| Multilingual Information Retrieval | Belebele | nDCG@200.6653 | 33 | |
| Reading Comprehension | Belebele c | Accuracy (Normalized)37.11 | 32 | |
| Reading Comprehension | BELEBELE | Average RC Score (BELEBELE)80 | 31 | |
| Retrieval | BelebeleRetrieval | nDCG@1096.26 | 26 | |
| Machine Reading Comprehension | Belebele Target language | MRC Score55.78 | 24 | |
| Reading Comprehension | Belebele EN | Accuracy75.33 | 22 | |
| Multilingual Reading Comprehension | Belebele | Accuracy79.8 | 18 | |
| Question Answering | Belebele English | Accuracy94.56 | 18 | |
| Machine Reading Comprehension | Belebele Source language en | MRC Score89.8 | 16 | |
| Reading Comprehension | Belebele Ukrainian (test) | Accuracy89.56 | 14 | |
| Reading Comprehension | Belebele Spanish (test) | Accuracy91 | 14 | |
| Reading Comprehension | Belebele Polish | Accuracy87.56 | 13 | |
| Machine Reading Comprehension | BELEBELE Indonesian | Accuracy (Target Language)67.1 | 13 | |
| Retrieval | Belebele | nDCG@10 (Afr)81.9 | 12 | |
| Retrieval | Belebele | Afr Score92.7 | 12 | |
| Reading Comprehension | Belebele Hindi | Accuracy84 | 12 | |
| Reading Comprehension | Belebele Korean (test) | Accuracy90 | 12 | |
| Reading Comprehension | Belebele French | Score74.2 | 12 | |
| Reading Comprehension | Belebele Indonesian 1.0 (test) | Accuracy91 | 11 | |
| Reading Comprehension | Belebele Arabic 1.0 (test) | Belebele Score91 | 11 |
Showing 25 of 69 rows