Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

PMC-VQA

Benchmarks

Task NameDataset NameSOTA ResultTrend
Multiple-choice Visual Question AnsweringPMC-VQA (test)
Accuracy89.3
50
Medical Visual Question AnsweringPMC-VQA
Accuracy62
44
Open-ended Visual Question AnsweringPMC-VQA (test)
Accuracy36.8
23
Open-ended Visual Question AnsweringPMC-VQA (test-initial)
BLEU-135.4
19
Medical Visual Question AnsweringPMC-VQA (test)
Accuracy55.3
13
Multi-modal Question AnsweringPMC-VQA
Accuracy70.3
12
Visual Question AnsweringPMC-VQA (test)
Accuracy38.6
5
Fill-in-the-blank Visual Question AnsweringPMC-VQA (test)
Accuracy38.1
5
Medical Visual Question AnsweringPMC-VQA
Pass@170.15
4
Showing 9 of 9 rows