SLAKE
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Medical Visual Question Answering | SLAKE | Accuracy89.2 | 134 | |
| Medical Visual Question Answering | SLAKE closed-end | Accuracy92.39 | 54 | |
| Medical Visual Question Answering | SLAKE (test) | Closed Accuracy91.6 | 29 | |
| Visual Question Answering | Slake | Closed Accuracy91.1 | 27 | |
| Medical Visual Question Answering | SLAKE Open | Accuracy86.85 | 26 | |
| Hallucination Detection | SLAKE (All) | AUC62.12 | 21 | |
| Hallucination Detection | SLAKE Open-Ended | AUC67.68 | 21 | |
| Visual Question Answering | SLAKE (test) | Accuracy86.8 | 7 | |
| Medical Visual Question Answering | SLAKE cross-domain | Accuracy74.6 | 6 | |
| Medical Visual Question Answering | SLAKE (held-out) | Accuracy74.5 | 6 | |
| Medical Visual Question Answering | SLAKE X-ray Patient Movement 1.0 (test) | Accuracy0.875 | 5 | |
| Medical Visual Question Answering | SLAKE CT Low Dose 1.0 (test) | Accuracy69.7 | 5 | |
| Medical Visual Question Answering | SLAKE CT Sparse View 1.0 (test) | Accuracy63.64 | 5 | |
| Medical Visual Question Answering | SLAKE MRI Banding 1.0 (test) | Accuracy77 | 5 | |
| Medical Visual Question Answering | SLAKE MRI Aliasing 1.0 (test) | Accuracy60.26 | 5 | |
| Medical Visual Question Answering | SLAKE MRI Human Motion 1.0 (test) | Accuracy75.41 | 5 | |
| Visual Question Answering | SLAKE Unrelated Sentences 1.0 (test) | ACC70.85 | 5 | |
| Visual Question Answering | SLAKE Replace Characters 1.0 (test) | Accuracy71.59 | 5 | |
| Visual Question Answering | SLAKE Swap Characters 1.0 (test) | Accuracy69.93 | 5 | |
| Visual Question Answering | SLAKE Add Characters 1.0 (test) | Accuracy73.8 | 5 | |
| Visual Question Answering | SLAKE Delete Characters 1.0 (test) | Accuracy73.25 | 5 | |
| Medical Visual Question Answering | SLAKE | Pass@182.62 | 4 | |
| Medical Image Captioning | SLAKE | Final Score0.5386 | 4 | |
| Open/Close-ended VQA | Slake VQA | Token F189.3 | 2 | |
| Medical Visual Question Answering | SLAKE X-ray Original VQA 1.0 (test) | Accuracy88.89 | 1 |
Showing 25 of 27 rows