OKVQA
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Visual Question Answering | OKVQA | Top-1 Accuracy75.29 | 283 | |
| Knowledge-based Visual Question Answering | OKVQA | Accuracy0.885 | 101 | |
| Visual Question Answering | OKVQA (val) | VQA Score66.1 | 101 | |
| Uncertainty Quantification | OKVQA | AUROC79.9 | 62 | |
| Visual Question Answering | OKVQA | ASR100 | 42 | |
| Visual Question Answering | OKVQA | VQA Accuracy59.57 | 34 | |
| Visual Question Answering | OKVQA | Accuracy64.56 | 34 | |
| Vision Question Answering | OKVQA | ASR (Success Rate)73.07 | 30 | |
| Knowledge-based Visual Question Answering | OKVQA (val) | Accuracy66.7 | 27 | |
| Knowledge-based Visual Question Answering | OKVQA (test) | Accuracy64.3 | 18 | |
| Knowledge-based Visual Retrieval | OKVQA Google Search (test) | PR@584.66 | 16 | |
| Cognition and Reasoning | OKVQA | Score61.92 | 16 | |
| Visual Question Answering | OKVQA | AUROC0.761 | 14 | |
| Visual Question Answering | OKVQA | VQA Accuracy (Clean)60.3 | 14 | |
| Visual Question Answering | OKVQA | Accuracy60.13 | 14 | |
| Visual Question Answering | OKVQA (test) | Accuracy65.7 | 11 | |
| Visual Question Answering | OKVQA (I) (test) | VQA Accuracy57.8 | 11 | |
| Visual Question Answering | OKVQA N=200 | Score D61.7 | 11 | |
| Visual Question Answering | OKVQA (N=100) | CD Score56.6 | 11 | |
| Visual Question Answering | OKVQA N=40 | CD48.8 | 11 | |
| Object Hallucination Probing | OKVQA POPE Popular | Accuracy85 | 11 | |
| Visual Question Answering | OKVQA | Score57.79 | 10 | |
| Visual Question Answering | OKVQA | OKVQA Score60.2 | 9 | |
| Visual Question Answering | OKVQA | AUROC0.788 | 9 | |
| Knowledge-based Question Answering | OKVQA | Score64.56 | 9 |
Showing 25 of 35 rows