Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

SimpleVQA

Benchmarks

Task NameDataset NameSOTA ResultTrend
Visual Question AnsweringSimpleVQA
Accuracy0.743
164
General visual question answeringSimpleVQA
Pass@176.2
33
Multimodal SearchSimpleVQA
Accuracy64.1
15
Visual Question AnsweringSimpleVQA-EN
Accuracy50.6
14
Expert ReasoningSimpleVQA
Accuracy39.78
12
FactualitySimpleVQA
Factuality Score43.51
8
Visual instruction tuningSimpleVQA
Score49.5
6
General VQASimpleVQA
Accuracy74.06
5
Showing 8 of 8 rows