CWQ
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Knowledge Graph Question Answering | CWQ | Hit@179.3 | 212 | |
| Knowledge Graph Question Answering | CWQ (test) | Hits@176.9 | 125 | |
| Multi-Hop Knowledge Graph Question Answering | CWQ | Hits@181.4 | 64 | |
| Knowledge Base Question Answering | CWQ (test) | F1 Score81.3 | 44 | |
| Knowledge Base Question Answering | CWQ Freebase (test) | Hits@186 | 38 | |
| Multi-hop Question Answering | CWQ | Pass@155.8 | 36 | |
| Knowledge Base Question Answering | CWQ | Hits@186.3 | 30 | |
| Question Answering | CWQ | Accuracy23.62 | 30 | |
| Discriminative Evaluation | CWQ (test) | Binary Accuracy92.88 | 24 | |
| Knowledge Base Question Answering | CWQ | Answer F151.74 | 18 | |
| Question Answering | CWQ | Hits@172.5 | 17 | |
| Knowledge Base Completion | CWQ 50% KB | MRR61.4 | 16 | |
| Knowledge Base Completion | CWQ (30% KB) | MRR58.8 | 16 | |
| Knowledge Graph Question Answering | CWQ Switzerland | Accuracy68 | 14 | |
| Entity Linking | CWQ (test) | Precision82.43 | 13 | |
| Knowledge Graph Question Answering | CWQ | # Calls1 | 12 | |
| Knowledge Base Question Answering | CWQ 50% KB | Hits@150.8 | 12 | |
| Knowledge Base Question Answering | CWQ 30% KB | Hits@150.2 | 12 | |
| Hallucination Detection | CWQ | F1 Score87.4 | 11 | |
| Hallucination Detection | CWQ | F1 Score87.4 | 11 | |
| Multi-hop Reasoning | CWQ | Hits@182.2 | 10 | |
| Knowledge Graph Question Answering | CWQ multi-entity | F1 Score64.9 | 7 | |
| Knowledge Base Question Answering | CWQ (hidden test) | Accuracy67.1 | 7 | |
| Hallucination Detection | CWQ | LLM Calls0 | 6 | |
| Complex Question Answering | CWQ | Total Score14.85 | 4 |
Showing 25 of 28 rows