Share your thoughts, 1 month free Claude Pro on usSee more

Prefix-risk ranking on TerminalBench (held-out)

0.557AUPRC

PrefixGuard (GRU)

Updated 26d ago

Evaluation Results

Method	Links
PrefixGuard (GRU) 2026.05		0.557
PrefixGuard (Transformer) 2026.05		0.555
PrefixGuard (FSM) 2026.05		0.447
GRU (Raw-text control) 2026.05		0.37
Transformer (Raw-text control) 2026.05		0.363
FSM (Raw-text control) 2026.05		0.272
PrefixGuard (DFA) 2026.05		0.184
DFA (Raw-text control) 2026.05		0.137
GPT-5.4-mini 2026.05		0.127
DeepSeek-V4-Pro 2026.05		0.107
PPM LSTM 2026.05		0.093