WebQSP
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Knowledge Base Question Answering | WebQSP (test) | Hit@188.6 | 145 | |
| Knowledge Graph Question Answering | WebQSP | Hit@192.6 | 143 | |
| Knowledge Graph Question Answering | WebQSP (test) | Hit93.2 | 61 | |
| Knowledge Base Question Answering | WebQSP Freebase (test) | Hits@189.9 | 60 | |
| Multi-Hop Knowledge Graph Question Answering | WebQSP | Hits@196.7 | 50 | |
| Knowledge Base Question Answering | WebQSP → GrailQA-Tech (test) | F1 Score74.6 | 36 | |
| Question Answering | WebQSP | Accuracy80.8 | 35 | |
| Knowledge Base Question Answering | WebQSP | Hits@193.15 | 25 | |
| Knowledge Base Question Answering | WebQSP → GraphQA-Pop (test) | F167 | 20 | |
| Knowledge Graph Question Answering | WebQSP | Hit Rate0.9353 | 19 | |
| Knowledge Base Completion | WebQSP 50% KB | MRR63 | 16 | |
| Knowledge Base Completion | WebQSP 30% KB | MRR0.603 | 16 | |
| Knowledge Graph Question Answering | WebQSP 3-hop | Accuracy0.819 | 16 | |
| Knowledge Graph Question Answering | WebQSP 1-hop | Accuracy76.9 | 16 | |
| Knowledge Base Question Answering | WebQSP v1 (test) | F1 Score79.6 | 16 | |
| Entity Linking | WebQSP All entities (test) | Precision92.17 | 15 | |
| Knowledge Base Question Answering | WebQSP 50% KB | Hits@173.8 | 12 | |
| Knowledge Base Question Answering | WebQSP (30% KB) | Hits@173 | 12 | |
| Multi-hop Reasoning | WebQSP | Hits@193.15 | 10 | |
| Knowledge Graph Retrieval | WebQSP (test) | Triple Recall (1-hop)96.6 | 9 | |
| Knowledge Graph Question Answering | WebQSP | Hits@191.68 | 9 | |
| Multi-hop QA | WebQSP | Accuracy91.5 | 9 | |
| Subgraph Retrieval | WebQSP | Hits@1091.58 | 8 | |
| Semantic Parsing | WebQSP (test) | EM83.1 | 8 | |
| Knowledge Base Question Answering | WebQSP | Hits@193.6 | 6 |
Showing 25 of 35 rows