Our new X account is live! Follow @wizwand_team for updates

Vision-Language Evaluation on MME (test)

136.43Communication Score

BLIVA

Updated 2d ago

Evaluation Results

Method	Links
BLIVA 2023.09		136.43	57.5	77.5	60	180	138.33	81.67	180	87.5	155.1	140.88	151.5	89.5	133.25	119.23
MMICL 2023.09		136.43	82.5	132.5	77.5	170	160	81.67	156.67	100	146.26	141.76	153.75	136.13	135.5	129.33
InstructBLIP 2023.09		129.29	40	65	57.5	185	143.33	66.67	153.33	72.5	123.81	101.18	153	79.75	134.25	107.47
Lynx 2023.09		110.71	17.5	42.5	45	195	151.67	90	170	77.5	124.83	118.24	164.5	162	119.5	113.5
BLIP-2 2023.09		110	40	65	75	160	135	73.33	148.33	110	141.84	105.59	145.25	138	136.5	113.13
Otter 2023.09		106.43	72.5	57.5	70	195	88.33	86.67	113.33	72.5	138.78	172.65	158.75	137.25	129	114.19
LRV-Instruction 2023.09		100.71	70	85	72.5	165	111.67	86.67	165	110	139.04	112.65	147.98	160.53	101.25	116.29
GIT2 2023.09		99.29	50	67.5	45	190	118.33	96.67	158.33	65	112.59	145.88	158.5	140.5	146.25	113.85
Cheetor 2023.09		98.57	77.5	57.5	87.5	180	96.67	80	116.67	100	147.28	164.12	156	145.73	113.5	115.79
LaVIN 2023.09		87.14	65	47.5	50	185	88.33	63.33	75	107.5	79.59	47.35	136.75	93.5	87.25	86.66
LLaMA-Adapter-V2 2023.09		81.43	62.5	50	55	120	50	48.33	75	125	99.66	86.18	148.5	150.25	69.75	87.26
mPLUG-Owl 2023.09		78.57	60	80	57.5	120	50	50	55	65	136.05	100.29	135.5	159.25	96.25	88.82
VPGTrans 2023.09		64.29	50	77.5	57.5	70	85	63.33	73.33	77.5	84.01	53.53	141.75	64.75	77.25	74.27
MiniGPT-4 2023.09		59.29	45	0	40	68.33	55	43.33	75	57.5	41.84	54.41	71.75	54	60.5	51.85
LLaVA 2023.09		57.14	50	57.5	50	50	50	50	55	50	50	48.82	50	50	49	51.25
MultiModal-GPT 2023.09		49.29	62.5	60	55	61.67	55	58.33	68.33	82.5	57.82	73.82	68	69.75	59.5	62.97
VisualGLM-6B 2023.09		39.29	45	50	47.5	85	50	48.33	55	42.5	65.99	53.24	146.25	83.75	75.25	63.36