SLAKE
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Medical Visual Question Answering | SLAKE | Accuracy89.2 | 247 | |
| Medical Visual Question Answering | SLAKE Open 1.0 (test) | ECE2.6 | 96 | |
| Medical Visual Question Answering | SLAKE Closed 1.0 (test) | ECE0 | 96 | |
| Medical Visual Question Answering | SLAKE Open | ACE45.2 | 96 | |
| Medical Visual Question Answering | SLAKE Closed | ACE36.7 | 96 | |
| Medical Visual Question Answering | SLAKE (test) | Closed Accuracy91.8 | 67 | |
| Medical Visual Question Answering | SLAKE closed-end | Accuracy92.39 | 54 | |
| Hallucination Detection | SLAKE (All) | AUC78.91 | 37 | |
| Hallucination Detection | SLAKE Open-Ended | AUC79.94 | 37 | |
| Medical Visual Question Answering | SLAKE | Closed Score93.27 | 33 | |
| Visual Question Answering | Slake | Closed Accuracy91.1 | 27 | |
| Medical Visual Question Answering | SLAKE Open | Accuracy86.85 | 26 | |
| Medical Visual Question Answering | SLAKE | Accuracy71.55 | 25 | |
| Visual Question Answering | SLAKE Open | Token Recall88.2 | 22 | |
| Hallucination detection | SLAKE | AUC71.9 | 20 | |
| Visual Question Answering | SLAKE (test) | Accuracy74.7 | 20 | |
| Medical Visual Understanding | SLAKE | Accuracy84.7 | 18 | |
| Multimodal Reasoning | SLAKE | Accuracy87.61 | 18 | |
| Medical Visual Question Answering | SLAKE-CP | Open Score30.2 | 18 | |
| Medical Visual Question Answering | SLAKE Closed | AUROC73.2 | 17 | |
| Medical Visual Question Answering | SLAKE | Closed Accuracy90.7 | 17 | |
| Visual Question Answering | SLAKE Closed | Exact Match92 | 11 | |
| Medical Visual Question Answering | SLAKE English | Closed-Ended Accuracy89.9 | 9 | |
| Medical Visual Question Answering | SLAKE Open | AUROC76.6 | 9 | |
| Visual Question Answering | SLAKE Closed | Accuracy88.2 | 7 |
Showing 25 of 48 rows