Share your thoughts, 1 month free Claude Pro on usSee more

Multimodal Safety Evaluation on BeaverTails-V

2.9Safety Score

Qwen2.5-VL-7B + TIS

Updated 1mo ago

Evaluation Results

Method	Links
Qwen2.5-VL-7B + TIS 2026.03		2.9	2.77	2.88
Qwen2.5-VL-3B + SFT+GRPO 2026.03		2.85	2.75	2.89
Qwen2.5-VL-3B + SFT+DPO+GRPO 2026.03		2.84	2.78	2.87
Qwen2.5-VL-7B + SFT+GRPO 2026.03		2.84	2.84	2.91
Qwen2.5-VL-7B + SaFeR-VLM 2026.03		2.83	2.33	2.54
Qwen2.5-VL-7B + SPA-VL 2026.03		2.82	2.6	2.27
Qwen2.5-VL-7B + SFT+DPO+GRPO 2026.03		2.82	2.88	2.93
Qwen2.5-VL-3B + TIS 2026.03		2.75	2.37	2.69
Qwen2.5-VL-3B + SPA-VL 2026.03		2.74	2.59	2.23
Qwen2.5-VL-3B + SaFeR-VLM 2026.03		2.72	2.27	2.28
Qwen2.5-VL-7B + SFT+DPO 2026.03		2.72	2.81	2.91
Qwen2.5-VL-7B + VLGuard 2026.03		2.64	1.73	1.9
Qwen2.5-VL-7B + SFT 2026.03		2.62	2.66	2.86
Qwen2.5-VL-3B + VLGuard 2026.03		2.61	1.69	1.86
Qwen2.5-VL-3B + SFT+DPO 2026.03		2.58	2.66	2.77
Qwen2.5-VL-3B + SFT 2026.03		2.57	2.61	2.77
Qwen2.5-VL-7B + SIA 2026.03		2.5	2.33	2.17
Qwen2.5-VL-7B 2026.03		1.67	2.7	2.14
Qwen2.5-VL-7B + ECSO 2026.03		1.58	2.67	2.15
Qwen2.5-VL-3B + SIA 2026.03		0.82	2.01	1.39
Qwen2.5-VL-3B + ECSO 2026.03		0.73	2.41	1.66
Qwen2.5-VL-3B 2026.03		0.59	2.56	1.68