Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

MKQA

Benchmarks

Task NameDataset NameSOTA ResultTrend
Question AnsweringMKQA
fEM47.6
27
Cross-lingual retrievalMKQA
Avg. Recall@10076.6
27
Multilingual Retrieval-Augmented GenerationMKQA 1.0 (test)
Accuracy (AR)0.6255
18
Open-domain Question AnsweringMKQA
Accuracy15.94
12
Question RetrievalMKQA (full)
Retrieval Accuracy29.9
12
RetrievalMKQA eng
nDCG@115.1
6
Information RetrievalMKQA eng
nDCG@1035.2
5
Open-domain question answeringMKQA English Language (test)
NOB Accuracy45.42
5
Open-domain question answeringMKQA Target Language (test)
NOB Accuracy40.64
5
Showing 9 of 9 rows