PMC-VQA
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Medical Visual Question Answering | PMC-VQA | Accuracy62 | 74 | |
| Multiple-choice Visual Question Answering | PMC-VQA (test) | Accuracy89.3 | 50 | |
| Medical Visual Question Answering | PMC-VQA (test) | Accuracy84.6 | 36 | |
| Open-ended Visual Question Answering | PMC-VQA (test) | Accuracy36.8 | 23 | |
| Open-ended Visual Question Answering | PMC-VQA (test-initial) | BLEU-135.4 | 19 | |
| Visual Question Answering | PMC-VQA (test) | Accuracy45.3 | 15 | |
| Visual Question Answering | PMC-VQA | Accuracy55.8 | 13 | |
| Medical Visual Question Answering (Multiple-choice) | PMC-VQA OOD | Accuracy54.3 | 12 | |
| Multi-modal Question Answering | PMC-VQA | Accuracy70.3 | 12 | |
| Vision-Language Medical Reasoning | PMC-VQA | Token Cost (tokens/question)3,818 | 11 | |
| Medical Diagnosis | PMC-VQA | Accuracy59.28 | 8 | |
| Fill-in-the-blank Visual Question Answering | PMC-VQA (test) | Accuracy38.1 | 5 | |
| Medical Visual Question Answering | PMC-VQA | Pass@170.15 | 4 |
Showing 13 of 13 rows