Share your thoughts, 1 month free Claude Pro on usSee more

Safety Alignment on BeaverTails V

93.37Safety Score

SaFeR-ToolKit (+ SFT+GRPO) [3B]

Updated 1mo ago

Evaluation Results

Method	Links
SaFeR-ToolKit (+ SFT+GRPO) [3B] 2026.03		93.37	79.42	92.69
SaFeR-ToolKit (+ SFT+DPO+GRPO) [7B] 2026.03		93.22	89.66	94.92
SaFeR-ToolKit (+ SFT+DPO+GRPO) [3B] 2026.03		92.88	82.2	89.49
Qwen2.5-VL-3B + TIS 2026.03		87.46	58.81	78.64
Qwen2.5-VL-3B + SPA-VL 2026.03		87.44	70.46	39.05
Qwen2.5-VL-3B + SaFeR-VLM 2026.03		84.58	53.22	50
SaFeR-ToolKit (+ SFT) [3B] 2026.03		83.22	70.17	83.22
SaFeR-ToolKit (+ SFT+DPO) [3B] 2026.03		82.88	75.08	82.37
Qwen2.5-VL-3B + VLGuard 2026.03		79.66	8.81	17.8
Qwen2.5-VL-7B 2026.03		63.9	74.24	26.61
Qwen2.5-VL-3B 2026.03		37.8	65.76	6.78
Qwen2.5-VL-3B + ECSO 2026.03		36.61	56.27	6.27
Qwen2.5-VL-3B + SIA 2026.03		31.02	39.66	4.75