Safety Benchmarks
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Safety Alignment | Safety Benchmarks (Sorry-bench, StrongREJECT, WildJailbreak, JBB-PAIR, JBB-GCG) | Average Score42.34 | 21 | |
| Safety Evaluation | Safety Benchmarks ASB, InjecAgent, AHarm, ASecBench | ASB Score61.1 | 18 | |
| Safety Evaluation | Safety Benchmarks VLG-1, VLG-2, Ch3EF | VLG-1 Score93.91 | 17 | |
| Lifelong Safety Adaptation | Safety Benchmarks (Final-day) | Final-day Macro F1 Score96.2 | 15 | |
| Text-to-Image Safety Evaluation | Safety Benchmarks (MMA, Sneaky, I2P-S, Ring, P4D) | MMA80.4 | 10 | |
| Safety Evaluation | Safety Benchmarks | Average ASR0.4 | 10 | |
| Jailbreak Attack Evaluation | Five Safety Benchmarks AdvBench, HarmBench, HarmfulQ, JBBench, StrongReject | ASR7.69 | 6 | |
| Safety Evaluation | Safety Benchmarks Overall | Cost per Accuracy Point ($)0.001 | 4 | |
| Safety Evaluation | Safety Benchmarks Aggregate (test) | Generation Quality (Std Prefix)73.6 | 4 | |
| Safety Evaluation | Five Safety Benchmarks direct_q | ASR0.02 | 3 |
Showing 10 of 10 rows