BoolQ
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Boolean Question Answering | BoolQ | Accuracy91.26 | 350 | |
| Question Answering | BoolQ | Accuracy90.9 | 317 | |
| Common Sense Reasoning | BoolQ | Accuracy92.4 | 280 | |
| Reading Comprehension | BOOLQ | Accuracy94.47 | 279 | |
| Reading Comprehension | BoolQ | Accuracy (BoolQ)88.47 | 258 | |
| Question Answering | BoolQ | Accuracy90.03 | 233 | |
| Text Classification | BoolQ | Accuracy90.7 | 124 | |
| Question Answering | BoolQ (test) | Accuracy91.752 | 68 | |
| Boolean Question Answering | BoolQ | Accuracy85.9 | 57 | |
| Boolean Question Answering | BoolQ | Accuracy88.91 | 56 | |
| Multiple-choice Question Answering | BoolQ | MC Accuracy0.887 | 50 | |
| Factual Knowledge | Bool Q | Accuracy87.7 | 44 | |
| Reading Comprehension | BoolQ (test) | Accuracy99.87 | 43 | |
| Commonsense Reasoning | BoolQ | Accuracy87.6 | 41 | |
| Boolean Question Answering | BoolQ (test) | Accuracy (Avg)86.7 | 41 | |
| Zero-shot Common Sense Reasoning | BoolQ | Accuracy81.28 | 39 | |
| Reading Comprehension | BoolQ | Accuracy (%)85.66 | 37 | |
| Boolean Question Answering | BoolQ | Zero-shot Accuracy0.8229 | 36 | |
| Commonsense Reasoning | BoolQ (test) | Accuracy89.45 | 35 | |
| Reading Comprehension | BoolQ (val) | Accuracy97.7 | 34 | |
| Feature Attribution | BoolQ | Comprehensiveness72 | 33 | |
| Yes/No Reading Comprehension | BoolQ 1.0 (test) | Normalized Accuracy69 | 33 | |
| Closed-domain QA | BoolQ | EM85.2 | 30 | |
| Boolean Question Answering | BoolQ | Accuracy92.3 | 29 | |
| Hallucination Detection | BoolQ | ROC-AUC94.76 | 28 |
Showing 25 of 90 rows