Our new X account is live! Follow @wizwand_team for updates

Multi-modal Understanding on MMBench (dev)

80.6Overall Score

Mini-Gemini-HD

Updated 2d ago

Evaluation Results

Method	Links
Mini-Gemini-HD 2024.03		80.6	-	-	-	-	-	-
Mini-Gemini 2024.03		79.6	-	-	-	-	-	-
LLaVA-NeXT 2024.03		79.6	-	-	-	-	-	-
Mini-Gemini 2024.03		75.6	-	-	-	-	-	-
Gemini Pro 2024.03		75.2	-	-	-	-	-	-
GPT-4V 2024.03		75.1	-	-	-	-	-	-
Mini-Gemini-HD 2024.03		74.7	-	-	-	-	-	-
LLaVA-NeXT 2024.03		70.7	-	-	-	-	-	-
Mini-Gemini 2024.03		69.3	-	-	-	-	-	-
LLaVA-1.5 2024.03		69.2	-	-	-	-	-	-
Mini-Gemini-HD 2024.03		68.6	-	-	-	-	-	-
Mini-Gemini 2024.03		68.5	-	-	-	-	-	-
LLaVA-NeXT 2024.03		68.1	-	-	-	-	-	-
LLaMA-VID 2024.03		66.6	-	-	-	-	-	-
Qwen-VL-Plus 2024.03		66.2	-	-	-	-	-	-
Mini-Gemini-HD 2024.03		65.8	-	-	-	-	-	-
MMICL 2023.09		65.24	44.32	77.85	64.78	66.5	53.6	70.64
LLaVA-1.5 2024.03		65.2	-	-	-	-	-	-
LLaMA-VID 2024.03		65.1	-	-	-	-	-	-
JiuTian 2023.09		64.7	46.6	76.5	66.7	66.5	51.6	68.7
CogVLM-Chat 2024.03		63.7	-	-	-	-	-	-
mPLUG-Owl 2023.09		62.3	37.5	75.4	56.8	67.3	52.4	67.2
LMEye 2023.09		61.3	36.9	73	55.4	60	68	68.9
Qwen-VL-Chat 2024.03		60.6	-	-	-	-	-	-
Shikra 2023.09		60.2	33.5	69.6	53.1	61.8	50.4	71.7
Mini-Gemini 2024.03		59.8	-	-	-	-	-	-
MobileVLM 2024.03		59.6	-	-	-	-	-	-
Shikra 2024.03		58.8	-	-	-	-	-	-
IDEFICS-80B 2024.03		54.5	-	-	-	-	-	-
OtterHD 2024.03		53.6	-	-	-	-	-	-
Otter-I 2023.09		48.3	22.2	63.3	39.4	46.8	36.4	60.6
G2PT 2023.09		39.8	14.8	46.7	31.5	41.8	34.4	49.8
Qwen-VL+ 2024.03		38.2	-	-	-	-	-	-
LLaVA 2023.09		36.2	15.9	53.6	28.6	41.8	20	40.4
InstructBLIP 2024.03		36	-	-	-	-	-	-
InstructBLIP 2023.09		33.9	21.6	47.4	22.5	33	24.4	41.1
VisualGLM 2023.09		33.5	11.4	48.8	27.7	35.8	17.6	41.5
PandaGPT 2023.09		30.6	15.3	41.5	22	20.3	20.4	47.9
MMGPT 2023.09		16	1.1	23.8	20.7	18.3	5.2	18.3
MiniGPT-4 2023.09		12	13.6	32.9	8.9	28.8	11.2	28.3