GQA
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Visual Question Answering | GQA | Accuracy83.2 | 1,445 | |
| Visual Question Answering | GQA | Accuracy74.9 | 524 | |
| Visual Question Answering | GQA (test-dev) | Accuracy73.9 | 236 | |
| Visual Question Answering | GQA | Accuracy77.5 | 218 | |
| Visual Question Answering | GQA (test) | Accuracy89.3 | 204 | |
| Visual Question Answering | GQA | Mean Accuracy65.8 | 196 | |
| Visual Question Answering | GQA | Score71.3 | 193 | |
| Performance Estimation | GQA | MAE0 | 184 | |
| Visual Question Answering | GQA | GQA Score64.83 | 152 | |
| Visual Reasoning | GQA | Accuracy73.01 | 96 | |
| Visual Question Answering | GQA | GQA Score63.4 | 75 | |
| Visual Question Answering | GQA (test-std) | Accuracy65.65 | 74 | |
| Visual Question Answering | GQA | Accuracy65.34 | 59 | |
| Object Hallucination Probing | GQA Adversarial | Accuracy83.27 | 55 | |
| Multi-modal Vision-Language Understanding | GQA | Accuracy64.2 | 51 | |
| Object Hallucination Probing | GQA POPE Popular | Accuracy86.07 | 49 | |
| Object Hallucination Evaluation | GQA (Random) | Accuracy90.13 | 43 | |
| Object Hallucination Probing | GQA POPE Random | Accuracy (GQA POPE)89.93 | 42 | |
| Visual Question Answering | GQA | Accuracy75.77 | 36 | |
| General Visual Question Answering | GQA | Accuracy61.94 | 35 | |
| Multi-turn Visual Question Answering | MT-GQA | Acc165.45 | 33 | |
| Visual Question Answering | GQA | Exact Match63.3 | 32 | |
| Visual Question Answering | GQA balanced (test-dev) | Accuracy77.4 | 32 | |
| Visual Question Answering | GQA (val) | Accuracy83.39 | 32 | |
| Visual Question Answering | GQA | Accuracy61.97 | 31 |
Showing 25 of 148 rows