Share your thoughts, 1 month free Claude Pro on usSee more

Safety Alignment on BeaverTails V

93.37Safety Score

SaFeR-ToolKit (+ SFT+GRPO) [3B]

Updated 1mo ago

Evaluation Results

Method	Links
SaFeR-ToolKit (+ SFT+GRPO) [3B] 2026.03		93.37	79.42	92.69
SaFeR-ToolKit (+ SFT+DPO+GRPO) [7B] 2026.03		93.22	89.66	94.92
SaFeR-ToolKit (+ SFT+DPO+GRPO) [3B] 2026.03		92.88	82.2	89.49
COPSD (Standard) 2026.06		90.49	93.32	-
Qwen2.5-VL-3B + TIS 2026.03		87.46	58.81	78.64
Qwen2.5-VL-3B + SPA-VL 2026.03		87.44	70.46	39.05
Qwen2.5-VL-3B + SaFeR-VLM 2026.03		84.58	53.22	50
COPSD (Hybrid) 2026.06		84.21	75.27	-
GRPO 2026.06		84.04	60.75	-
COPSD (Hybrid) 2026.06		83.53	92.91	-
SaFeR-ToolKit (+ SFT) [3B] 2026.03		83.22	70.17	83.22
SaFeR-ToolKit (+ SFT+DPO) [3B] 2026.03		82.88	75.08	82.37
Qwen2.5-VL-3B + VLGuard 2026.03		79.66	8.81	17.8
COPSD (Standard) 2026.06		77.76	81.29	-
OPD 2026.06		76.23	82.15	-
SFT 2026.06		74.53	83.94	-
Safe-RLHF-V 2026.06		65.87	25.43	-
Qwen2.5-VL-7B 2026.03		63.9	74.24	26.61
GRPO 2026.06		63.84	50.7	-
OPD 2026.06		62.14	62.65	-
SFT 2026.06		59.59	56.45	-
Safe-RLHF-V 2026.06		52.29	46.85	-
Qwen3-VL-4B 2026.06		50	50	-
Qwen2.5-VL-7B 2026.06		50	50	-
Qwen2.5-VL-3B 2026.03		37.8	65.76	6.78
Qwen2.5-VL-3B + ECSO 2026.03		36.61	56.27	6.27
Qwen2.5-VL-3B + SIA 2026.03		31.02	39.66	4.75