Share your thoughts, 1 month free Claude Pro on usSee more

Multimodal Safety Evaluation on MM-SafetyBench

2.73Safety Score

Qwen2.5-VL-3B + SFT+DPO+GRPO

Updated 1mo ago

Evaluation Results

Method	Links
Qwen2.5-VL-3B + SFT+DPO+GRPO 2026.03		2.73	2.62	2.93
Qwen2.5-VL-7B + TIS 2026.03		2.73	2.42	2.75
Qwen2.5-VL-7B + SFT+DPO+GRPO 2026.03		2.73	2.7	2.94
Qwen2.5-VL-3B + SFT+GRPO 2026.03		2.71	2.64	2.89
Qwen2.5-VL-7B + SaFeR-VLM 2026.03		2.7	2.13	2.42
Qwen2.5-VL-7B + SFT+GRPO 2026.03		2.7	2.65	2.93
Qwen2.5-VL-3B + SaFeR-VLM 2026.03		2.64	2.24	2.33
Qwen2.5-VL-3B + TIS 2026.03		2.62	2.17	2.55
Qwen2.5-VL-7B + VLGuard 2026.03		2.6	1.61	2.01
Qwen2.5-VL-7B + SFT+DPO 2026.03		2.55	2.53	2.93
Qwen2.5-VL-3B + VLGuard 2026.03		2.54	1.6	1.92
Qwen2.5-VL-7B + SFT 2026.03		2.5	2.28	2.84
Qwen2.5-VL-3B + SFT+DPO 2026.03		2.42	2.34	2.8
Qwen2.5-VL-3B + SPA-VL 2026.03		2.34	2.46	2.08
Qwen2.5-VL-3B + SFT 2026.03		2.31	2.29	2.73
Qwen2.5-VL-7B + SIA 2026.03		2.1	2.17	1.97
Qwen2.5-VL-7B + SPA-VL 2026.03		2.08	2.35	2.19
Qwen2.5-VL-7B + ECSO 2026.03		1.33	2.31	2.02
Qwen2.5-VL-7B 2026.03		1.31	2.31	1.98
Qwen2.5-VL-3B + SIA 2026.03		0.97	1.76	1.37
Qwen2.5-VL-3B + ECSO 2026.03		0.4	2.25	1.62
Qwen2.5-VL-3B 2026.03		0.05	2.37	1.7