Vizwiz
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Visual Question Answering | VizWiz | Accuracy100 | 1,525 | |
| Visual Question Answering | VizWiz (test) | Accuracy69.3 | 79 | |
| Visual Question Answering | VizWiz (test-dev) | Accuracy76.4 | 65 | |
| Visual Question Answering | Vizwiz (val) | VQA Score81.7 | 51 | |
| Vision Understanding | VizWiz (test) | VizWiz Score54.7 | 24 | |
| Comprehensive Evaluation | VizWiz (val) | Score69.16 | 16 | |
| Visual Question Answering | VizWiz (val test) | Accuracy39.76 | 15 | |
| Visual Question Answering | VizWiz | VQA Accuracy (Clean)41.5 | 14 | |
| Image Captioning | VizWiz (test) | CIDEr125.7 | 10 | |
| Image Captioning | VizWiz-Captions (test-dev) | CIDEr-D123 | 10 | |
| Visual Question Answering | VizWiz I (test) | VQA Accuracy57.2 | 10 | |
| Image Captioning | VizWiz | CIDEr36 | 9 | |
| Visual Question Answering | VizWiz (val-lite) | Accuracy54.36 | 6 | |
| Open-Ended Visual Question Answering | VizWiz (val) | Accuracy56.39 | 6 | |
| Visual Question Answering | VizWiz Far OOD | Accuracy23.05 | 6 | |
| Visual Question Answering | VizWiz (test-std) | Accuracy65.4 | 5 | |
| Referring Expression Grounding | VizWizG (test-dev) | IoU65.7 | 5 | |
| Categorical Visual Question Answering | VizWiz | Accuracy81 | 4 | |
| Hallucination Detection | VizWiz (val) | AUPRC85.17 | 4 | |
| Image Captioning | VizWiz-Cap (val) | CIDEr125.7 | 4 | |
| Image question answering | VizWiz public server | Accuracy70.1 | 3 | |
| Image captioning | VizWiz public server | CIDEr120.8 | 3 | |
| Answerability | VizWiz 2022 (test) | AP83.78 | 3 | |
| Answerability | VizWiz 2022 (test-dev) | AP84.13 | 3 | |
| Visual Question Answering | VizWiz 2022 (test-std) | Accuracy60.15 | 3 |
Showing 25 of 27 rows