Our new X account is live! Follow @wizwand_team for updates

Multimodal Jailbreak Defense on MM-SafetyBench (full)

1.03ASR (Illegal Activity - S)

RAI

Updated 4d ago

Evaluation Results

Method	Links
RAI 2026.02		1.03	2.06	0	0	9.09	0	4.59	15.6	18.35	0.61	3.07	3.07	4.17	6.94	9.03	1.3	1.95	3.9	4.71
RAI 2026.02		1.03	4.12	2.06	2.27	11.36	2.27	0.92	12.52	9.84	0	1.23	1.84	4.17	8.33	12.5	1.95	1.3	1.3	4.39
shiftDC 2026.02		2.78	2.48	9.28	6.82	12.95	22.5	2.48	12.66	17.62	2.39	7.36	13.07	6.25	13.12	18.54	5.65	7.99	15	9.94
Adashield 2026.02		4.18	3.71	13.92	10.23	19.43	33.75	3.72	18.99	26.42	3.59	11.04	19.6	9.37	19.69	27.81	8.47	11.98	22.5	14.91
CoCA 2026.02		8.35	7.42	27.84	20.46	38.86	67.5	7.43	37.98	52.85	7.18	22.09	39.2	18.75	39.38	55.63	16.95	23.96	45	29.82
ECSO 2026.02		8.54	7.59	28.46	20.91	39.73	69	7.6	38.82	54.02	7.34	22.58	40.08	19.16	40.25	56.87	17.32	24.49	46	30.49
shiftDC 2026.02		8.66	10.82	21.34	6.82	20.45	25.23	3.03	18.72	19.27	4.42	14.54	17.85	8.12	18.96	20.83	6.82	18.51	22.29	14.82
Original 2026.02		9.28	8.25	30.93	22.73	43.18	75	8.26	42.2	58.72	7.98	24.54	43.56	20.83	43.75	61.81	18.83	26.62	50	33.14
Adashield 2026.02		12.99	16.24	32.01	10.23	30.68	37.84	4.54	28.08	28.9	6.62	21.81	26.78	12.19	28.44	31.25	10.23	27.76	33.44	22.22
CoCA 2026.02		25.98	32.47	64.02	20.46	61.36	75.68	9.08	56.15	57.8	13.25	43.62	53.56	24.37	56.87	62.5	20.46	55.52	66.87	44.45
ECSO 2026.02		26.56	33.19	65.44	20.91	62.73	77.36	9.28	57.4	59.08	13.54	44.59	54.75	24.91	58.13	63.88	20.91	56.75	68.36	45.43
Original 2026.02		28.87	36.08	71.13	22.73	68.18	84.09	10.09	62.39	64.22	14.72	48.47	59.51	27.08	63.19	69.44	22.73	61.69	74.3	49.38