Share your thoughts, 1 month free Claude Pro on usSee more

Trace-level safety monitoring on ImpossibleBench

95.7ROC-AUC

Meerkat

Updated 4d ago

Evaluation Results

Method	Links
Meerkat 2026.04		95.7
Meerkat 2026.04		95.1
Buffer 2026.04		94.9
Buffer 2026.04		94.8
Meerkat 2026.04		94.4
Monitor 2026.04		94.3
Bayesian 2026.04		93.5
Bayesian 2026.04		93.5
Monitor 2026.04		93.3
Meerkat 2026.04		92.8
Monitor 2026.04		92.4
Meerkat 2026.04		92.4
Buffer 2026.04		91.5
Buffer 2026.04		91.4
Monitor 2026.04		90
Meerkat 2026.04		89.8
Meerkat 2026.04		89.8
Monitor 2026.04		89.3
Bayesian 2026.04		88
Bayesian 2026.04		88
Bayesian 2026.04		87.8
Bayesian 2026.04		87.8
Meerkat 2026.04		87.6
Buffer 2026.04		87.3
Buffer 2026.04		87.1
Monitor 2026.04		87
Buffer 2026.04		85.5
Buffer 2026.04		85.5
Bayesian 2026.04		84.8
Bayesian 2026.04		84.8
Monitor 2026.04		80
Naive Agent 2026.04		78.9
Monitor 2026.04		78
Naive Agent 2026.04		74.2
Naive Agent 2026.04		73.8
Naive Agent 2026.04		71.8
Naive Agent 2026.04		70
Naive Agent 2026.04		61.9
Naive Agent 2026.04		50
Naive Agent 2026.04		50