CWEval
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Secure Code Generation | CWEval | pass@148.2 | 29 | |
| Secure Code Generation | CWEval | Functionality92.27 | 22 | |
| Vulnerability injection | CWEval Python | Attack Success Rate (ASR)66.67 | 14 |
Showing 3 of 3 rows
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Secure Code Generation | CWEval | pass@148.2 | 29 | |
| Secure Code Generation | CWEval | Functionality92.27 | 22 | |
| Vulnerability injection | CWEval Python | Attack Success Rate (ASR)66.67 | 14 |