Over-refusal Evaluation Suite
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Over-refusal | Over-refusal Evaluation Suite (XSTest, WildJailbreak, WildGuard, OKTest, OR-Bench) | XSTest Refusal Rate (%)3.2 | 24 | |
| Overrefusal Evaluation | Over-refusal Evaluation Suite OB, FB | Overrefusal Rate (OB)9.9 | 7 |
Showing 2 of 2 rows