CyberSecEval
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Secure Code Generation | CyberSecEval SCG | Safety79.06 | 17 | |
| Insecure Coding Practice | CyberSecEval Instruction 1.0 | C Score72.1 | 14 | |
| Insecure Coding Practice | CyberSecEval Autocomplete 1 | C85.9 | 14 | |
| Secure Code Generation | CYBERSECEVAL | Autocomplete79.38 | 8 | |
| Cybersecurity Attack Success Rate | CyberSecEval | CyberSecEval ASR100 | 4 | |
| Content Safety Detection | CyberSecEval | F1 Score92.2 | 2 | |
| Malicious Cyberactivity | CyberSecEval MITRE | Refusal Rate57.1 | 2 | |
| Secure Code Generation | CyberSecEval Instruct | Secure Code Generation (%)86.01 | 2 | |
| Prompt Injection Robustness | CyberSecEval 2 | Robustness91 | 2 |
Showing 9 of 9 rows