| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| VQA 1.0 (test-dev) | Ensemble of 7 Att. models | Overall Accuracy66.7 | 100 | 4mo ago | |
| VQA 1.0 (test-standard) | MUTAN | Overall Accuracy67.36 | 50 | 4mo ago | |
| VQA (test-standard) | Human | Accuracy (Overall)83.3 | 32 | 4mo ago | |
| LLS48-VQA | MIS-DINOv2 | BLEU-10.5245 | 26 | 4mo ago | |
| PMC-VQA (test) | MedVInT-TE | Accuracy36.8 | 23 | 4mo ago | |
| PMC-VQA (test-initial) | MedVInT-TE | BLEU-135.4 | 19 | 4mo ago | |
| CXR-PA | T2R-R2 | Accuracy45.32 | 14 | 1mo ago | |
| Covid19 | T2R-R2 | Accuracy49.43 | 14 | 1mo ago | |
| SLAKE | Accuracy64.92 | 14 | 1mo ago | ||
| Med-CXR | T2R-R3 | Accuracy31.73 | 14 | 1mo ago | |
| Delta-SECOND | Delta-LLaVA | H-CQS METEOR32.74 | 13 | 3mo ago | |
| EarthVLSet 1.0 (test) | EarthVLNet | BLEU-10.5726 | 12 | 4mo ago | |
| LLaVA-in-the-Wild (LLaVA-W) | LLaVA-665K | Score68.5 | 10 | 2mo ago | |
| CXR | CheXagent | BERTScore0.86 | 8 | 4mo ago | |
| LLaVA Bench v1 (test) | DRESS | Relevance37.18 | 7 | 4mo ago | |
| LLaVA Eval v1 (test) | DRESS | Conversation Score77.67 | 7 | 4mo ago | |
| ODIR | EyExIn | F1 Score56.7 | 6 | 4mo ago | |
| Retina | EyExIn | F1 Score67.8 | 6 | 4mo ago | |
| JSIEC | EyExIn | F1 Score63.1 | 6 | 4mo ago | |
| TM4K | EyExIn | F1 Score72.91 | 6 | 4mo ago | |
| VizWiz (val) | Llama-2 Chat 7B | Accuracy56.39 | 6 | 4mo ago | |
| WSI-Bench | HistoSelect | WSI-P (Morphology)53.8 | 5 | 4mo ago |
