SLAKE
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Medical Visual Question Answering | SLAKE | Accuracy90.62 | 289 | |
| Medical Visual Question Answering | SLAKE Open 1.0 (test) | ECE2.6 | 96 | |
| Medical Visual Question Answering | SLAKE Closed 1.0 (test) | ECE0 | 96 | |
| Medical Visual Question Answering | SLAKE Open | ACE45.2 | 96 | |
| Medical Visual Question Answering | SLAKE Closed | ACE36.7 | 96 | |
| Medical Visual Question Answering | SLAKE (test) | Closed Accuracy91.8 | 82 | |
| Medical Visual Question Answering | SLAKE closed-end | Accuracy92.39 | 54 | |
| Hallucination Detection | SLAKE (All) | AUC78.91 | 37 | |
| Hallucination Detection | SLAKE Open-Ended | AUC79.94 | 37 | |
| Medical Visual Question Answering | SLAKE | Closed Accuracy90.7 | 35 | |
| Medical Visual Question Answering | SLAKE | Closed Score93.27 | 33 | |
| Multimodal Reasoning | SLAKE | Accuracy90.62 | 30 | |
| Visual Question Answering | Slake | Closed Accuracy91.1 | 27 | |
| Visual Question Answering | SLAKE Open | Token Recall89.9 | 26 | |
| Medical Visual Question Answering | SLAKE Open | Accuracy86.85 | 26 | |
| Medical Visual Question Answering | SLAKE | Accuracy71.55 | 25 | |
| Hallucination detection | SLAKE | AUC71.9 | 20 | |
| Visual Question Answering | SLAKE (test) | Accuracy74.7 | 20 | |
| Medical Visual Understanding | SLAKE | Accuracy84.7 | 18 | |
| Medical Visual Question Answering | SLAKE-CP | Open Score30.2 | 18 | |
| Medical Visual Question Answering | SLAKE Closed | AUROC73.2 | 17 | |
| Medical Visual Question Answering | slake | ECE14.06 | 16 | |
| Open-ended Visual Question Answering | SLAKE | Accuracy64.92 | 14 | |
| Medical Visual Question Answering | Slake 12 | F188.4 | 14 | |
| Visual Question Answering | SLAKE Closed | Accuracy93.2 | 11 |
Showing 25 of 52 rows