PathVQA
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Medical Visual Question Answering | PathVQA | Overall Accuracy72.61 | 92 | |
| Medical Visual Question Answering | PathVQA | Accuracy76.8 | 80 | |
| Medical Visual Question Answering | PathVQA (test) | Accuracy78.2 | 55 | |
| Medical Visual Question Answering | PathVQA closed-end | Accuracy93.63 | 35 | |
| Vision-Language Medical Reasoning | PathVQA | Token Cost (tokens/question)0.7 | 29 | |
| Visual Question Answering | PathVQA open-ended | Exact Match (EM)4.88 | 25 | |
| Visual Question Answering (Closed-ended) | PathVQA closed-ended | Accuracy95 | 23 | |
| Medical Visual Question Answering | PathVQA Open | Accuracy38.65 | 22 | |
| Hallucination detection | PathVQA | AUC82 | 20 | |
| Visual Question Answering | PathVQA | Accuracy (Closed)92.9 | 19 | |
| Visual Question Answering | PathVQA (test) | Overall Accuracy92.7 | 19 | |
| Visual Question Answering | PathVQA (Open) | Token Recall39 | 15 | |
| Medical Visual Question Answering (Free-text) | PathVQA OOD | Accuracy62.3 | 12 | |
| Multi-modal Question Answering | PathVQA | Accuracy65.9 | 12 | |
| Visual Question Answering | PathVQA Closed | Token Recall0.93 | 7 | |
| Visual Question Answering | PathVQA | Accuracy74.4 | 6 | |
| Medical Visual Question Answering | PathVQA (held-out) | Accuracy59.9 | 6 | |
| Visual Question Answering | PathVQA | BLEU-163.93 | 5 | |
| Out-of-distribution Detection | PathVQA (PVQA) (test) | FPR6.24 | 5 |
Showing 19 of 19 rows