Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

WebQSP

Benchmarks

Task NameDataset NameSOTA ResultTrend
Knowledge Graph Question AnsweringWebQSP
Hit@193.3
174
Knowledge Base Question AnsweringWebQSP (test)
Hit@188.6
145
Knowledge Graph Question AnsweringWebQSP (test)
Hit93.2
85
Multi-Hop Knowledge Graph Question AnsweringWebQSP
Hits@196.7
69
Knowledge Base Question AnsweringWebQSP Freebase (test)
Hits@189.9
60
Knowledge Base Question AnsweringWebQSP
Hits@196
53
Multi-hop Question AnsweringWebQSP
Pass@168
36
Knowledge Base Question AnsweringWebQSP → GrailQA-Tech (test)
F1 Score74.6
36
Question AnsweringWebQSP
Accuracy80.8
35
Knowledge Graph Question AnsweringWebQSP
ECR (%)76.8
34
Knowledge Graph Question AnsweringWebQSP
Accuracy (ACC)68
28
Hallucination DetectionWebQSP
F1 Score82
22
Knowledge Graph Question AnsweringWebQSP
Hits@1 Accuracy84.73
22
Knowledge Base Question AnsweringWebQSP → GraphQA-Pop (test)
F167
20
Knowledge Graph Question AnsweringWebQSP
Hit Rate0.9353
19
Multi-Answer Question AnsweringWebQSP
Precision50.3
16
Knowledge Base CompletionWebQSP 50% KB
MRR63
16
Knowledge Base CompletionWebQSP 30% KB
MRR0.603
16
Knowledge Graph Question AnsweringWebQSP 3-hop
Accuracy0.819
16
Knowledge Graph Question AnsweringWebQSP 1-hop
Accuracy76.9
16
Knowledge Base Question AnsweringWebQSP v1 (test)
F1 Score79.6
16
Entity LinkingWebQSP All entities (test)
Precision92.17
15
Entity LinkingWebQSP (test)
Precision91.18
13
Knowledge Base Question AnsweringWebQSP 50% KB
Hits@173.8
12
Knowledge Base Question AnsweringWebQSP (30% KB)
Hits@173
12
Showing 25 of 48 rows