Share your thoughts, 1 month free Claude Pro on usSee more

Personalized Multimodal Evaluation on Persona-MME 128k configuration

88.06VDR

Gemini-2.5-Flash

Updated 3d ago

Evaluation Results

Method	Links
Gemini-2.5-Flash 2026.03		88.06	92.55	88	73.44	67.86	47.89	50	62.5	58.33	72.22	77.19	75	80	80.9	74.9
GPT-5 2026.03		85.71	98.72	93.85	67.92	74.47	70.97	65.31	76.67	70.97	85.11	81.63	76.19	75.81	92.25	82.95
GPT-4o 2026.03		73.68	92.31	86.15	62.96	62.5	54.84	61.22	61.67	50	56.25	75.51	73.33	79.03	78.87	71.9
Qwen3-VL-8B 2026.03		63.38	84.21	76.83	68.18	61.4	58.11	67.86	67.53	40.54	82.46	76.19	79.31	88	71.39	70.75
GPT-4o-mini 2026.03		54.39	89.74	78.46	64.81	64.58	59.68	61.22	68.33	45.31	54.17	71.43	73.33	75.81	65.14	66.44
Qwen2.5-VL-7B 2026.03		52.11	49.47	52.44	57.58	52.63	48.65	57.14	55.84	52.7	50.88	60.32	56.9	64	55	54.62
Claude-3.7-Sonnet 2026.03		51.47	91.11	80.26	76.19	60.38	61.43	61.54	61.97	38.24	64.81	66.67	66.67	70.42	80.65	70.4
PersonaVLM 2026.03		50.7	83.16	81.71	72.73	59.65	54.05	73.21	58.44	62.16	75.44	74.6	82.76	92	92.22	77.08
OneVision-1.5-8B 2026.03		42.86	59.57	59.26	49.23	62.5	46.58	69.09	48.68	41.89	73.21	58.06	64.91	68.92	53.93	55.88
InternVL3-38B 2026.03		38.03	89.47	78.05	63.64	68.42	64.86	60.71	72.73	44.59	57.89	71.43	70.69	81.33	63.06	66.01
InternVL3-8B 2026.03		29.58	77.89	74.39	62.12	59.65	54.05	46.43	66.23	43.24	61.4	76.19	75.86	77.33	54.17	60.08
Qwen3-30B-A3B 2026.03		29.58	85.26	82.93	75.76	70.18	63.51	64.29	63.64	44.59	68.42	77.78	82.76	86.67	81.39	72.65
Random 2026.03		25	25	25	25	25	25	25	25	25	25	25	25	25	50	32.11