CyberSecEval
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Secure Code Generation | CyberSecEval SCG | Safety79.06 | 17 | |
| Insecure Coding Practice | CyberSecEval Instruction 1.0 | C Score72.1 | 14 | |
| Insecure Coding Practice | CyberSecEval Autocomplete 1 | C85.9 | 14 | |
| Cybersecurity Attack Success Rate | CyberSecEval | CyberSecEval ASR100 | 4 | |
| Malicious Cyberactivity | CyberSecEval MITRE | Refusal Rate57.1 | 2 | |
| Secure Code Generation | CyberSecEval Instruct | Secure Code Generation (%)86.01 | 2 | |
| Prompt Injection Robustness | CyberSecEval 2 | Robustness91 | 2 |
Showing 7 of 7 rows