Share your thoughts, 1 month free Claude Pro on usSee more

Prefix-risk ranking on WebArena (held-out)

90AUPRC

PrefixGuard (GRU)

Updated 26d ago

Evaluation Results

Method	Links
PrefixGuard (GRU) 2026.05		90
PrefixGuard (Transformer) 2026.05		89.2
GRU (Raw-text control) 2026.05		87.1
Transformer (Raw-text control) 2026.05		85.4
PrefixGuard (FSM) 2026.05		83.7
PrefixGuard (DFA) 2026.05		79.2
DFA (Raw-text control) 2026.05		74.5
FSM (Raw-text control) 2026.05		63.9
DeepSeek-V4-Pro 2026.05		45
GPT-5.4-mini 2026.05		40.7
PPM LSTM 2026.05		38.2