Share your thoughts, 1 month free Claude Pro on usSee more

Safety Guardrail Classification on CHILLGuard 1.0 (test)

90.01F1 Score (Category A1)

CHILLGuard-4B

Updated 1mo ago

Evaluation Results

Method	Links
CHILLGuard-4B 2026.06		90.01	89.24	88.55	90.72	87.32	93.3	91.97	92.83	90.49	89.64	89.67	92.3	90.52	90.35	88.8	90.74	93.59	88.73	90.48	79.29	82.14	82.83	82.4	80.24	81.38	91.56	91.44	89.65	92.68	91.82	93.07	93.46	91.95	91.82	91.55	91.69	89.43
CHILLGuard-8B 2026.06		90	88.9	88.55	91.38	87.55	92.8	92.04	94.34	90.7	90.77	89.81	92.52	90.61	91.77	88.29	91.16	93.3	89.3	90.84	80.41	83.7	82.95	84.07	80.69	82.36	91.88	92.75	89.38	92.78	91.94	93.99	93.35	92.3	92.31	98.66	90.99	89.77
CHILLGuard-1.7B 2026.06		80.99	81.66	79.98	81.82	81.09	82.66	84.93	84.41	82.19	79.9	82.81	84.68	82.74	86.16	82.72	87.71	86.04	82.72	83.94	66.96	77.68	75.86	78.11	71.08	73.94	85.74	87.18	88.34	93.09	88.18	88.36	90.4	88.76	79.08	81.21	80.15	82.72
Qwen3Guard-0.6B-Strict 2026.06		78.53	74.74	78.01	78.04	78	70.56	75.48	77.56	76.37	75.58	75.31	74.24	73.64	73.8	69.92	75.05	72.7	72.25	73.61	72.64	73.69	73.92	72.75	66.17	71.83	72.28	79.16	82.73	86.14	84.21	82.15	83.46	81.45	45.71	44.78	45.25	73.97
Qwen3Guard-8B-Strict 2026.06		78.53	75.88	77.77	79.76	79.8	75.53	79.32	82.65	78.66	76.98	77.63	78.28	75.36	78.65	75.56	78.39	77.38	75.45	77.08	75.3	76.78	76.33	74.44	72.32	75.04	77.26	84.12	88.06	90.31	90.28	86.5	87.12	86.24	51.81	46.98	49.4	77.44
Qwen3Guard-4B-Strict 2026.06		77.09	74.64	76.45	78.66	78.04	75.01	76.16	81.16	77.15	74.87	75.74	77.7	74.77	77.81	72.33	76.77	73.28	74.37	75.29	76.03	78.19	76.66	76.67	74.02	76.31	75.87	83.64	87.02	89.17	88.72	86.41	87.02	85.41	45.34	46.37	45.86	76.32
Qwen3Guard-0.6B-Loose 2026.06		63.16	54.51	57.49	43.09	51.22	36.3	47.01	39.97	49.09	51.24	43.63	42.35	40.87	39.6	30.08	38.28	37.31	38.79	40.24	53.7	56.71	58.33	48.88	39.23	51.37	54.03	53.33	54.43	62.14	63.19	65.33	62.13	59.23	9.48	10.33	9.91	46.65
Qwen3Guard-4B-Loose 2026.06		61.5	46.64	48.98	38.85	42.05	40.33	40.03	39	44.67	42.06	36.44	41.65	28.52	40.5	25.96	45.86	36.03	34.87	36.88	49.95	53.29	55.12	33.02	36.89	45.65	56.6	53.75	53.55	56.33	71.43	71.92	66.54	61.45	5.78	5.71	5.75	43.84
Qwen3Guard-8B-Loose 2026.06		61	48.42	50.78	35.27	41.76	35.97	41.75	37.67	44.08	44.67	40.9	42.33	31.91	41.88	30.84	47.98	40.74	38.92	40.02	45.9	52.6	54.23	32.46	34.76	44.52	56.44	55.09	56.41	58.74	71.43	71.71	66.62	62.35	4.28	6.84	5.56	52.36
PolyGuard-7B 2026.06		51.92	47.51	56.78	80.91	69.98	79.61	59.92	81.58	66.03	71.35	70.04	69.44	65.01	74.55	71.2	75.89	72.19	71.95	71.29	77.81	80.66	79.45	78.88	77.58	78.88	79.66	87.51	87.69	90.42	89.37	87.64	87.19	87.07	55.04	60.01	57.53	73.83
LlamaGuard4-12B 2026.06		20.56	20.25	30.08	57.66	41.09	55.58	34.26	59.47	39.87	34.46	37.62	38.76	32.61	49.44	40.83	57.28	46.37	43.92	42.37	66.83	62.08	64.22	52.88	52.38	59.68	63.6	74.03	68.67	71.34	76.18	73.42	70.78	71.15	30.22	44.43	37.33	50.69
NemoGuard-8B 2026.06		16.21	18.69	16.14	60.51	52.72	63.49	24.69	61.64	39.26	65.98	49.43	66.04	61.16	67.66	68.71	66.95	68.12	68.62	64.74	66.96	69.52	72.74	59.94	59.05	65.64	75.14	76.02	74.35	66.9	86.92	84.17	80.79	77.76	17.24	17.62	17.43	58.2
WildGuard-7B 2026.06		15.42	14.02	16.67	40.92	42.25	41.9	30.01	48.62	31.23	47.48	42.72	45.59	37.75	55.27	46.49	59.14	53.78	52.13	48.93	57.28	65.99	63.33	57.68	52.11	59.28	64.62	73.98	77.85	78.07	83.7	82.01	78.99	77.03	19.73	26.67	23.2	50.72
LlamaGuard3-8B 2026.06		13.9	9.9	17.32	45.44	38.89	48.74	23.16	50.68	31	39.71	24.46	38.3	23.49	41.09	29.82	49.01	30.22	33.56	34.41	66.83	67.33	67.98	55.61	55.61	62.67	59.28	71.12	58.33	59.31	73.53	74.23	69.76	66.51	21.98	21.86	21.92	44.53
ShieldGemma-27B 2026.06		1.75	7.62	4.56	58.83	50.64	56.07	10.59	43.83	29.24	56	41.33	51.29	36.94	55.94	31.4	59.17	38.53	46.57	46.35	2.16	1.89	1.52	1.43	8.49	3.1	54.94	33.61	30.02	17.8	12.04	33.09	20.14	28.81	1.05	2.9	1.98	28.13
ShieldGemma-9B 2026.06		1.12	6.91	2.91	55.22	46.01	55.42	7.98	50.74	28.29	53.13	39.9	53.48	40.63	61.56	39.62	64.41	44.8	52.21	49.97	2.87	3.43	1.52	2.06	4.84	2.94	54.43	27.93	26.07	16.41	12.7	30.12	17.65	26.47	1.39	2.73	2.06	28.39