VQA
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Visual Question Answering | VQA v2 | Accuracy100 | 1,429 | |
| Visual Question Answering | VQA v2 (test-dev) | Overall Accuracy87.66 | 712 | |
| Visual Question Answering | VQA v2 (test-std) | Accuracy86.1 | 486 | |
| Visual Question Answering | VQA 2.0 (test-dev) | Accuracy86.5 | 337 | |
| Visual Question Answering | VQA v2 | Accuracy88.5 | 333 | |
| Visual Question Answering | VQAv2 | Accuracy97.4 | 196 | |
| Visual Question Answering | VQA 2.0 (val) | Accuracy (Overall)86.1 | 183 | |
| Visual Question Answering | VQA v2 (val) | Accuracy95.06 | 158 | |
| Visual Question Answering | VQA (test-dev) | Acc (All)78.25 | 147 | |
| Visual Question Answering | VQA v2 (test) | Accuracy86.1 | 142 | |
| Visual Question Answering | VQA (test-std) | Accuracy84 | 120 | |
| Open-Ended Visual Question Answering | VQA 1.0 (test-dev) | Overall Accuracy66.7 | 100 | |
| Visual Question Answering | VQAv2 (test) | VQA Accuracy83.4 | 82 | |
| Visual Question Answering | VQAv2 (test-dev) | Accuracy86.1 | 80 | |
| Visual Question Answering | VQA v2 | Accuracy80.1 | 71 | |
| Visual Question Answering | VQA | Accuracy82.18 | 66 | |
| Visual Question Answering (Multiple-choice) | VQA 1.0 (test-dev) | Accuracy (All)70.04 | 66 | |
| Visual Question Answering | VQA text | Accuracy83.2 | 61 | |
| Visual Question Answering | VQA (val) | Overall Accuracy79.54 | 55 | |
| Visual Question Answering | VQA v2 | VQAv2 Accuracy81.8 | 50 | |
| Open-Ended Visual Question Answering | VQA 1.0 (test-standard) | Overall Accuracy67.36 | 50 | |
| Visual Question Answering | VQA v2 | Overall Accuracy89.4 | 45 | |
| Visual Question Answering | VQAv2 (test-std) | Accuracy82.3 | 44 | |
| Visual Question Answer | VQA 1.0 (test-dev) | Overall Accuracy67.42 | 44 | |
| Visual Question Answering | VQA v2 | ASR100 | 42 |
Showing 25 of 149 rows