Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

SimpleVQA

Benchmarks

Task NameDataset NameSOTA ResultTrend
Visual Question AnsweringSimpleVQA
Accuracy0.7818
225
General visual question answeringSimpleVQA
Pass@176.2
40
Visual Question AnsweringSimpleVQA
Score79.6
38
Multimodal SearchSimpleVQA
Accuracy64.1
15
Visual Question AnsweringSimpleVQA-EN
Accuracy50.6
14
Expert ReasoningSimpleVQA
Accuracy39.78
12
FactualitySimpleVQA
Factuality Score43.51
8
Visual instruction tuningSimpleVQA
Score49.5
6
General VQASimpleVQA
Accuracy74.06
5
Showing 9 of 9 rows