MIRACL
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Multi-lingual retrieval | MIRACL (dev) | Avg Score72.3 | 43 | |
| Document Retrieval | MIRACL (dev) | NDCG@1049 | 41 | |
| Multilingual Document Retrieval | MIRACL (Evaluation set) | nDCG@1071.7 | 14 | |
| Retrieval | MIRACL Hard Negative | nDCG@10 (Hindi)22 | 12 | |
| Information Retrieval | MIRACL RetrievalHardNegatives | Average Performance70.4 | 9 | |
| Visual Document Retrieval | MIRACL Vision | Arabic0.7863 | 8 | |
| Information Retrieval | MIRACL zh | nDCG@1033.66 | 7 | |
| Document Retrieval | MIRACL Pseudo | AUC86.53 | 5 | |
| Document Retrieval | MIRACL Original | AUC0.8238 | 5 | |
| Visual Authentication | MIRACL-VC1 (test) | Test Accuracy98 | 5 | |
| Information Retrieval | MIRACL Telugu (dev) | NDCG@100.494 | 4 | |
| Information Retrieval | MIRACL Hindi (dev) | NDCG@1048.3 | 4 | |
| Information Retrieval | MIRACL Bengali (dev) | NDCG@100.606 | 4 | |
| User Authentication | MIRACL VC1 | Sensitivity99.8 | 1 |
Showing 14 of 14 rows