2WikiMHQA
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Multi-hop Question Answering | 2WikiMHQA | F1 Score85.56 | 85 | |
| Multi-hop Reasoning | 2WikiMHQA | AUROC0.7002 | 26 | |
| Multi-hop QA | 2WikiMHQA Wiki18 index (test) | Pass@455.1 | 20 | |
| Multi-hop Question Answering | 2WikiMHQA (test) | EM71.85 | 17 | |
| Multi-hop Question Answering | 2WikiMHQA in-distribution | Exact Match (EM)79.39 | 17 | |
| Question Answering | 2WikiMHQA (test) | EM45.8 | 14 | |
| Question Answering | 2WikiMHQA | Exact Match (EM)42.1 | 12 | |
| Multi-hop Question Answering | 2WikiMHQA | Query Latency (s/q)10.8 | 8 | |
| Multi-hop Question Answering | 2WikiMHQA 500 samples (test) | F1 Score91.1 | 8 | |
| Question Answering | 2WikiMHQA Covered Questions | Accuracy66.9 | 8 | |
| Question Answering | 2WikiMHQA All Questions | Accuracy61 | 8 | |
| Multi-hop Question Answering | 2WikiMHQA | EM37.8 | 7 | |
| Multi-hop QA | 2WikiMHQA | Average Violation0.56 | 4 | |
| Multi-hop Question Answering | 2WikiMHQA | GPT-Acc72.3 | 3 | |
| Question Answering | 2WikiMHQA | Accuracy71.2 | 2 | |
| Question Answering | 2WikiMHQA KET-RAG | Accuracy64.8 | 2 | |
| Knowledge Graph Question Answering | 2WikiMHQA strict (test) | Base Error0.592 | 1 | |
| Knowledge Graph Question Answering | 2WikiMHQA adaptive (test) | Base Error0.311 | 1 | |
| Uncertainty Quantification | 2WikiMHQA | Base Error0.311 | 1 | |
| Multi-hop Question Answering | 2WikiMHQA in-distribution v4 (test) | EM- | 0 |
Showing 20 of 20 rows