Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

MKQA

Benchmarks

Task NameDataset NameSOTA ResultTrend
Question AnsweringMKQA
fEM47.6
27
Multilingual Retrieval-Augmented GenerationMKQA 1.0 (test)
Accuracy (AR)0.6255
18
Cross-lingual retrievalMKQA
Avg. Recall@10075.5
16
Open-domain Question AnsweringMKQA
Accuracy15.94
12
Question RetrievalMKQA (full)
Retrieval Accuracy29.9
12
Open-domain question answeringMKQA English Language (test)
NOB Accuracy45.42
5
Open-domain question answeringMKQA Target Language (test)
NOB Accuracy40.64
5
Showing 7 of 7 rows