Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

MIRACL

Benchmarks

Task NameDataset NameSOTA ResultTrend
Document RetrievalMIRACL (dev)
NDCG@1049
41
Multilingual Document RetrievalMIRACL (Evaluation set)
nDCG@1071.7
14
Multi-lingual retrievalMIRACL (dev)
Avg Score71.5
11
Information RetrievalMIRACL RetrievalHardNegatives
Average Performance70.4
9
Visual Document RetrievalMIRACL Vision
Arabic0.7863
8
Document RetrievalMIRACL Pseudo
AUC86.53
5
Document RetrievalMIRACL Original
AUC0.8238
5
Visual AuthenticationMIRACL-VC1 (test)
Test Accuracy98
5
Information RetrievalMIRACL Telugu (dev)
NDCG@100.494
4
Information RetrievalMIRACL Hindi (dev)
NDCG@1048.3
4
Information RetrievalMIRACL Bengali (dev)
NDCG@100.606
4
User AuthenticationMIRACL VC1
Sensitivity99.8
1
Showing 12 of 12 rows