OpenBookQA
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Question Answering | OpenBookQA | Accuracy94.4 | 465 | |
| Question Answering | OpenBookQA | Accuracy96.07 | 319 | |
| Question Answering | OpenBookQA | Accuracy84.4 | 157 | |
| Question Answering | OpenBookQA (OBQA) (test) | OBQA Accuracy92.4 | 130 | |
| Question Answering | OpenBookQA | Accuracy95.2 | 119 | |
| Commonsense Reasoning | OpenBookQA | Accuracy91.2 | 108 | |
| Question Answering | OpenBookQA | Normalized Accuracy55.6 | 102 | |
| Reasoning | OpenBookQA | Accuracy88.4 | 92 | |
| Science Question Answering | OpenBookQA | Accuracy94.6 | 89 | |
| Multiple-choice Question Answering | OpenBookQA (test) | Accuracy91 | 61 | |
| Question Answering | OpenBookQA | Accuracy93.6 | 42 | |
| Open-book Question Answering | OpenBookQA 1.0 (test) | Accuracy35 | 33 | |
| Question Answering | OpenBookQA | Accuracy40.6 | 31 | |
| Multiple Choice Question Answering | OpenBookQA | Accuracy44.4 | 30 | |
| Question Answering | OpenBookQA 2018 | Acc_norm43 | 26 | |
| Zero-shot Reasoning | OpenbookQA | Accuracy44 | 26 | |
| Question Answering | OpenBookQA published (test) | Accuracy92.6 | 25 | |
| Question Answering | OpenBook-QA | Accuracy91.6 | 24 | |
| Question Answering | OpenbookQA | Accuracy87.6 | 23 | |
| Question Answering | OpenbookQA (OQA) (val) | Accuracy36.6 | 22 | |
| Question Answering | OpenBookQA (dev) | Accuracy90 | 22 | |
| Common Sense | OpenBookQA | Accuracy81.8 | 21 | |
| Question Answering | OpenBookQA | Normalized Generalization Error Approximation0.27 | 20 | |
| Question Answering | OpenBookQA | Generalization Error (G(W))1.51 | 20 | |
| Question Answering | OpenBookQA | Composite Score92.14 | 20 |
Showing 25 of 91 rows