Share your thoughts, 1 month free Claude Pro on usSee more

Multimodal Safety Evaluation on ToolkitBench

2.49Safety Score

Qwen2.5-VL-7B + SFT+DPO+GRPO

Updated 1mo ago

Evaluation Results

Method	Links
Qwen2.5-VL-7B + SFT+DPO+GRPO 2026.03		2.49	2.5	2.45
Qwen2.5-VL-7B + SFT+GRPO 2026.03		2.47	2.35	2.31
Qwen2.5-VL-3B + SFT+DPO+GRPO 2026.03		2.45	2.21	2.23
Qwen2.5-VL-3B + SFT+GRPO 2026.03		2.39	2.12	2.15
Qwen2.5-VL-7B + TIS 2026.03		2.37	1.94	1.98
Qwen2.5-VL-7B + SFT+DPO 2026.03		2.29	2.34	2.22
Qwen2.5-VL-7B + SaFeR-VLM 2026.03		2.26	1.62	1.66
Qwen2.5-VL-7B + SPA-VL 2026.03		2.23	1.97	1.45
Qwen2.5-VL-3B + SFT+DPO 2026.03		2.18	1.94	1.85
Qwen2.5-VL-7B + SFT 2026.03		2.15	2.15	2.01
Qwen2.5-VL-3B + SPA-VL 2026.03		2.13	1.78	1.27
Qwen2.5-VL-7B + SIA 2026.03		2.13	1.79	1.44
Qwen2.5-VL-3B + SaFeR-VLM 2026.03		2.08	1.46	1.43
Qwen2.5-VL-3B + SFT 2026.03		2.07	1.87	1.74
Qwen2.5-VL-7B 2026.03		2.07	2.05	1.54
Qwen2.5-VL-7B + ECSO 2026.03		2.04	2.02	1.52
Qwen2.5-VL-3B + TIS 2026.03		1.97	1.45	1.61
Qwen2.5-VL-7B + VLGuard 2026.03		1.77	1.19	1.11
Qwen2.5-VL-3B + VLGuard 2026.03		1.69	1.1	1.09
Qwen2.5-VL-3B + SIA 2026.03		1.62	1.46	1.01
Qwen2.5-VL-3B + ECSO 2026.03		1.58	1.66	1.13
Qwen2.5-VL-3B 2026.03		1.57	1.74	1.18