Share your thoughts, 1 month free Claude Pro on usSee more

Prefix-risk ranking on SkillsBench (held-out)

53.3AUPRC

PrefixGuard (GRU)

Updated 26d ago

Evaluation Results

Method	Links
PrefixGuard (GRU) 2026.05		53.3
PrefixGuard (Transformer) 2026.05		47.8
Transformer (Raw-text control) 2026.05		31.5
GRU (Raw-text control) 2026.05		31.5
PrefixGuard (FSM) 2026.05		27.3
FSM (Raw-text control) 2026.05		26
PrefixGuard (DFA) 2026.05		19
DFA (Raw-text control) 2026.05		14.7
GPT-5.4-mini 2026.05		10.1
PPM LSTM 2026.05		8.9
DeepSeek-V4-Pro 2026.05		8