ScienceQA
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Science Question Answering | ScienceQA | Accuracy99.8 | 916 | |
| Visual Question Answering | ScienceQA | Accuracy98.18 | 525 | |
| Science Question Answering | ScienceQA IMG | Accuracy98.2 | 357 | |
| Science Question Answering | ScienceQA (SQA) | Accuracy97.4 | 338 | |
| Scientific Question Answering | ScienceQA image | Accuracy98 | 281 | |
| Science Question Answering | ScienceQA (test) | Average Accuracy98.3 | 273 | |
| Science Question Answering | ScienceQA SQA-IMG | Accuracy92.8 | 186 | |
| Multimodal Science Question Answering | ScienceQA IMG | Accuracy95.78 | 152 | |
| Science Question Answering | ScienceQA SQA-I | Accuracy96.6 | 149 | |
| Visual Question Answering | ScienceQA img | Accuracy86.2 | 135 | |
| Visual Question Answering | ScienceQA (test) | Accuracy98.2 | 115 | |
| Question Answering | ScienceQA | Accuracy98.8 | 106 | |
| Visual Question Answering | ScienceQA image | Accuracy75.1 | 89 | |
| Scientific Reasoning | ScienceQA | Score96.21 | 86 | |
| Scientific Question Answering | ScienceQA | Accuracy94.4 | 83 | |
| Science Question Answering | ScienceQA IMG (test) | Accuracy98.4 | 74 | |
| Multimodal Question Answering | ScienceQA (test) | Accuracy92.53 | 73 | |
| Science Question Answering | ScienceQA Image | Score95.6 | 70 | |
| Science Question Answering | ScienceQA | IMG Score88.6 | 64 | |
| Multimodal Question Answering | ScienceQA | Accuracy97.8 | 61 | |
| Visual Question Answering | ScienceQA (SQA) | SQA Accuracy89.3 | 60 | |
| Multimodal Reasoning | ScienceQA | Average Accuracy97.85 | 45 | |
| Visual Question Answering | ScienceQA Image (test) | Accuracy96.2 | 45 | |
| Visual Question Answering | ScienceQA (SQAI) | Accuracy74.2 | 42 | |
| Out-of-scope refusal | ScienceQA out-of-scope (test) | Refusal Rate0 | 40 |
Showing 25 of 108 rows