MIRACL
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Multi-lingual retrieval | MIRACL (dev) | Avg Score72.3 | 51 | |
| Document Retrieval | MIRACL (dev) | NDCG@1049 | 41 | |
| Cross-lingual Retrieval | MIRACL | nDCG@100.423 | 24 | |
| Visual Document Retrieval | MIRACL Vision | Chinese0.7204 | 17 | |
| Multilingual Document Retrieval | MIRACL (Evaluation set) | nDCG@1071.7 | 14 | |
| Retrieval | MIRACL | nDCG@1092.9 | 12 | |
| Retrieval | MIRACL Hard Negative | nDCG@10 (Hindi)22 | 12 | |
| Information Retrieval | MIRACL RetrievalHardNegatives | Average Performance70.4 | 9 | |
| Reranking | MIRACL | Average nDCG@1070.07 | 8 | |
| Multilingual Information Retrieval | MIRACL zero-shot | nDCG@10 (ar)57.4 | 8 | |
| Retrieval | MIRACL European Languages | nDCG@1095.1 | 8 | |
| Information Retrieval | MIRACL zh | nDCG@1033.66 | 7 | |
| Information Retrieval | MIRACL Swahili (dev) | Δ nDCG@100.108 | 6 | |
| Information Retrieval | MIRACL Bengali (dev) | NDCG@100.727 | 6 | |
| Document Retrieval | MIRACL Pseudo | AUC86.53 | 5 | |
| Document Retrieval | MIRACL Original | AUC0.8238 | 5 | |
| Visual Authentication | MIRACL-VC1 (test) | Test Accuracy98 | 5 | |
| Information Retrieval | MIRACL Telugu (dev) | NDCG@100.494 | 4 | |
| Information Retrieval | MIRACL Hindi (dev) | NDCG@1048.3 | 4 | |
| User Authentication | MIRACL VC1 | Sensitivity99.8 | 1 |
Showing 20 of 20 rows