Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

HaloGuard 1.0: An Open Weights Constitutional Classifier for Multilingual AI Safety

About

We present HaloGuard 1.0, an open-weights implementation of the constitutional-classifier paradigm for input safety. It achieves state-of-the-art performance on English and multilingual prompt-safety benchmarks at roughly one-tenth the model size of current leading open guard models. The safety constitution is the organising structure of the corpus: a natural-language constitution of 46 policies and 2,940 subcategories drives synthetic data generation, with exhaustive one-to-one paired counterfactuals that hold topic and vocabulary fixed while flipping intent, a two-tier harmless design that separately targets boundary and baseline false positives (FPs), and balanced multilingual materialisation across 46 languages that treats language as a surface form appearing on both sides of the boundary rather than as an adversarial signal. Across seven prompt-safety benchmarks, HaloGuard 1.0-0.8B attains the best average F1 (90.9) of any open guard we evaluate, outperforming baselines up to 27B parameters (over 30 times larger) while holding false-positive rate (FPR) to 4.3 and false-negative rate (FNR) to 9.5. The HaloGuard 1.0-4B variant reaches average F1 of 92.1 and FPR of 3.5, spending its extra capacity on precision rather than recall. A structured adjudication of the remaining failures indicates that most apparent missed-harm cases are benchmark mislabels rather than genuine model misses. An always-on adversarial red-teaming protocol continuously hardens the guard against both content-level and agentic attacks. We release the models as open weights.

Navaneeth Sangameswaran, Preetham S, Ashmiya Lenin• 2026

Related benchmarks

TaskDatasetResultRank
Prompt ClassificationAegis
F1 Score88
54
Prompt ClassificationAegis 2.0
F1 Score89.2
42
Harmful prompt detectionSimpST
F1 Score100
27
Harmful prompt detectionHarmB
F1 Score99.2
27
Prompt ClassificationToxic
F1 Score84.5
26
Prompt Harmfulness ClassificationWildG
F1 Score96.2
22
Multilingual text query safetyPolyGuardPrompts
F1 Score88
19
Prompt Harmfulness ClassificationOAI
F1 Score87.4
10
Showing 8 of 8 rows

Other info

Follow for update