Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Multimodal Medical Question Answering on MIR residency exams OOD (test)
Loading...
50.4
Accuracy
ArogyaSutra(Qwen 2.5 VL 7B)
22.216
29.533
36.85
44.167
Jun 11, 2026
Accuracy
Updated 1mo ago
Evaluation Results
Method
Method
Links
Accuracy
ArogyaSutra(Qwen 2.5 VL 7B)
Zero-shot=true, Base M...
2026.06
50.4
Qwen3-VL-8B-Instruct
Zero-shot=true
2026.06
49.6
MedGemma-4B-it
Zero-shot=true
2026.06
45.2
Llama3-OpenBioLLM-8B
Zero-shot=true
2026.06
39.3
Qwen2.5-VL-3B-Instruct
Zero-shot=true
2026.06
38.6
BioMistral-7B
Zero-shot=true
2026.06
36.9
Qwen2.5-VL-7B-Instruct (Baseline)
Zero-shot=true
2026.06
35
MedVLM-R1
Zero-shot=true
2026.06
23.6
LLaVA-v1.6-34B
Zero-shot=true
2026.06
23.3
Feedback
Search any
task
Search any
task