SQA
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Visual Question Answering | SQA | Accuracy93.42 | 41 | |
| Sequential Question Answering | SQA (test) | Accuracy (All)74.5 | 33 | |
| Visual Question Answering | SQA-Image | Accuracy70.2 | 25 | |
| Question Answering | SQA | Accuracy79.62 | 24 | |
| Science Question Answering | SQA-I | Score79 | 24 | |
| Reasoning | SQA | Accuracy85 | 23 | |
| Science Question Answering | SQA IMG | Score97.67 | 23 | |
| Image-Language Understanding | SQA | EM71.6 | 21 | |
| Science Question Answering | SQA | Exact Match98.76 | 14 | |
| Table Question Answering | SQA (test) | Accuracy (All)72.4 | 11 | |
| Table Question Answering | SQA Perturbed (test) | Overall Accuracy0.723 | 8 | |
| Science Question Answering | SQA | Accuracy (SQA)70.1 | 7 | |
| Science Question Answering | SQA IMG | Accuracy70.7 | 7 | |
| Scholarly Question Answering | SQA CS V2 | Overall Score89.7 | 6 | |
| 3D Visual Question Answering | SQA (test) | EM@153.32 | 5 | |
| Sequential Question Answering | SQA | Overall Accuracy74.5 | 5 | |
| Sequential Question Answering | SQA first fold (dev) | Accuracy (ALL)68 | 5 | |
| Question Answering | SQA (test) | MRR0.7957 | 4 | |
| Visual Question Answering | SQA Short (test) | Accuracy94.8 | 2 | |
| 3D Visual Question Answering | SQA (val) | EM@152.05 | 1 |
Showing 20 of 20 rows