ScienceQA
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Science Question Answering | ScienceQA | Accuracy99.8 | 791 | |
| Visual Question Answering | ScienceQA | Accuracy98.18 | 446 | |
| Science Question Answering | ScienceQA IMG | Accuracy98.2 | 335 | |
| Science Question Answering | ScienceQA (SQA) | Accuracy88.8 | 273 | |
| Science Question Answering | ScienceQA (test) | Average Accuracy98.3 | 273 | |
| Scientific Question Answering | ScienceQA image | Accuracy98 | 259 | |
| Science Question Answering | ScienceQA SQA-IMG | Accuracy92.8 | 186 | |
| Multimodal Science Question Answering | ScienceQA IMG | Accuracy95.78 | 152 | |
| Visual Question Answering | ScienceQA img | Accuracy86.2 | 135 | |
| Science Question Answering | ScienceQA SQA-I | Accuracy96.6 | 122 | |
| Visual Question Answering | ScienceQA (test) | Accuracy98.2 | 115 | |
| Question Answering | ScienceQA | Accuracy96.3 | 96 | |
| Science Question Answering | ScienceQA IMG (test) | Accuracy98.4 | 74 | |
| Multimodal Question Answering | ScienceQA (test) | Accuracy92.53 | 73 | |
| Science Question Answering | ScienceQA Image | Score95.6 | 70 | |
| Science Question Answering | ScienceQA | IMG Score88.6 | 64 | |
| Scientific Question Answering | ScienceQA | Accuracy88.6 | 61 | |
| Multimodal Question Answering | ScienceQA | Accuracy97.8 | 61 | |
| Visual Question Answering | ScienceQA image | Accuracy75.1 | 58 | |
| Scientific Reasoning | ScienceQA | Score96.09 | 54 | |
| Multimodal Reasoning | ScienceQA | Average Accuracy97.85 | 45 | |
| Visual Question Answering | ScienceQA Image (test) | Accuracy96.2 | 45 | |
| Visual Question Answering | ScienceQA (SQA) | SQA Accuracy89.3 | 43 | |
| Out-of-scope refusal | ScienceQA out-of-scope (test) | Refusal Rate0 | 40 | |
| Multimodal Science Question Answering | ScienceQA | Overall Average Score88.4 | 36 |
Showing 25 of 96 rows