ScienceQA
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Science Question Answering | ScienceQA IMG | Accuracy98.2 | 256 | |
| Science Question Answering | ScienceQA | Accuracy98.5 | 229 | |
| Visual Question Answering | ScienceQA | Accuracy98.18 | 210 | |
| Science Question Answering | ScienceQA (test) | Average Accuracy97.7 | 208 | |
| Science Question Answering | ScienceQA (SQA) | Accuracy88.8 | 128 | |
| Science Question Answering | ScienceQA SQA-IMG | Accuracy92.8 | 114 | |
| Visual Question Answering | ScienceQA (test) | Accuracy98.2 | 95 | |
| Science Question Answering | ScienceQA SQA-I | Accuracy96.6 | 81 | |
| Scientific Question Answering | ScienceQA image | Accuracy80.4 | 53 | |
| Visual Question Answering | ScienceQA img | Accuracy86.2 | 52 | |
| Science Question Answering | ScienceQA | IMG Score88.6 | 49 | |
| Visual Question Answering | ScienceQA Image (test) | Accuracy96.2 | 45 | |
| Science Question Answering | ScienceQA IMG (test) | Accuracy82.1 | 45 | |
| Out-of-scope refusal | ScienceQA out-of-scope (test) | Refusal Rate0 | 40 | |
| Question Answering | ScienceQA | Accuracy96 | 40 | |
| Science Question Answering | ScienceQA Image | Score74.2 | 38 | |
| Multimodal Science Question Answering | ScienceQA | Overall Average Score88.4 | 36 | |
| Multimodal Question Answering | ScienceQA | Accuracy97.8 | 35 | |
| Visual Question Answering | ScienceQA (SQAI) | Accuracy74.2 | 35 | |
| Visual Question Answering | ScienceQA image | Accuracy75.1 | 33 | |
| Over-refusal evaluation | ScienceQA in-scope (test) | Biology Refusal Count0 | 32 | |
| Multimodal Science Question Answering | ScienceQA v1.0 (test) | Accuracy (Natural Language Component)97.47 | 31 | |
| Visual Question Answering | ScienceQA (SQA) | SQA Accuracy89.3 | 27 | |
| Science Question Answering | ScienceQA v1.0 (test) | Accuracy (G1-4)82.5 | 26 | |
| Science Question Answering | ScienceQA | Exact Match (EM)88.45 | 23 |
Showing 25 of 62 rows