SLAKE
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Medical Visual Question Answering | SLAKE | Accuracy89.2 | 239 | |
| Medical Visual Question Answering | SLAKE Open 1.0 (test) | ECE2.6 | 96 | |
| Medical Visual Question Answering | SLAKE Closed 1.0 (test) | ECE0 | 96 | |
| Medical Visual Question Answering | SLAKE Open | ACE45.2 | 96 | |
| Medical Visual Question Answering | SLAKE Closed | ACE36.7 | 96 | |
| Medical Visual Question Answering | SLAKE (test) | Overall Accuracy91 | 56 | |
| Medical Visual Question Answering | SLAKE closed-end | Accuracy92.39 | 54 | |
| Visual Question Answering | Slake | Closed Accuracy91.1 | 27 | |
| Medical Visual Question Answering | SLAKE Open | Accuracy86.85 | 26 | |
| Hallucination Detection | SLAKE (All) | AUC62.12 | 21 | |
| Hallucination Detection | SLAKE Open-Ended | AUC67.68 | 21 | |
| Hallucination detection | SLAKE | AUC71.9 | 20 | |
| Visual Question Answering | SLAKE (test) | Accuracy74.7 | 20 | |
| Medical Visual Question Answering | SLAKE Closed | AUROC73.2 | 17 | |
| Medical Visual Question Answering | SLAKE | Closed Accuracy90.7 | 17 | |
| Medical Visual Question Answering | SLAKE | Open Score82.78 | 10 | |
| Medical Visual Question Answering | SLAKE English | Closed-Ended Accuracy89.9 | 9 | |
| Medical Visual Question Answering | SLAKE Open | AUROC76.6 | 9 | |
| Medical Visual Question Answering | SLAKE-CP | Open Score28.9 | 9 | |
| Multimodal Visual Question Answering | SLAKE | Accuracy32.62 | 6 | |
| Medical Visual Question Answering | SLAKE cross-domain | Accuracy74.6 | 6 | |
| Medical Visual Question Answering | SLAKE (held-out) | Accuracy74.5 | 6 | |
| Medical Visual Question Answering | SLAKE | Accuracy71.55 | 5 | |
| Medical Visual Question Answering | SLAKE X-ray Patient Movement 1.0 (test) | Accuracy0.875 | 5 | |
| Medical Visual Question Answering | SLAKE CT Low Dose 1.0 (test) | Accuracy69.7 | 5 |
Showing 25 of 41 rows