Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Mr. TyDi

Benchmarks

Task NameDataset NameSOTA ResultTrend
Multilingual RetrievalMr. TyDi 1.0 (test)
MRR@100 (ar)72.4
8
Information RetrievalMr. TyDi Bengali v1.1 (test)
MRR@10042.3
7
Information RetrievalMr. TyDi Japanese v1.1 (test)
MRR@10032.4
7
Information RetrievalMr. TyDi Korean v1.1 (test)
MRR@10034.2
7
Information RetrievalMr. TyDi Swahili v1.1 (test)
MRR@10051.2
7
Monolingual Information RetrievalMr.Tydi Telugu official (test)
MRR@1000.424
5
Monolingual Information RetrievalMr.Tydi Bengali official (test)
MRR@10050.1
5
Showing 7 of 7 rows