Secure Code Generation on CWEval (pass@X metrics)
42.17pass@1
Vanilla Model
Updated 1mo ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2026.03 | 42.17 | 70.03 | 16.83 | 37.02 | |
2026.03 | 42.04 | 68.05 | 19.18 | 41.63 | |
2026.03 | 41.23 | 67.59 | 20.09 | 42.69 | |
2026.03 | 40.46 | 70.17 | 19.03 | 38.89 | |
2026.03 | 40.37 | 68.52 | 17.02 | 35.81 | |
2026.03 | 40.28 | 66.87 | 19.72 | 40.82 | |
2026.03 | 39.91 | 68.52 | 18.9 | 38.96 | |
2026.03 | 38.89 | 69.52 | 20.11 | 41.68 | |
2026.03 | 37.64 | 70.37 | 17.37 | 5.19 | |
2026.03 | 37.22 | 69.44 | 16.81 | 38.28 | |
2026.03 | 35.33 | 69.44 | 19.66 | 44.44 | |
2026.03 | 35.08 | 66.48 | 15.87 | 34.19 | |
2026.03 | 33.34 | 64.87 | 13.58 | 30.57 | |
2026.03 | 32.99 | 65.74 | 17.04 | 40.74 | |
2026.03 | 30.17 | 69.44 | 13.89 | 37.96 | |
2026.03 | 27.98 | 66.6 | 12.96 | 36.11 | |
2026.03 | 27.43 | 70.31 | 13.08 | 51.04 | |
2026.03 | 26.74 | 49.07 | 13.67 | 31.56 | |
2026.03 | 26.55 | 71.3 | 15.22 | 55.56 | |
2026.03 | 25.49 | 53.7 | 12.07 | 35.19 | |
2026.03 | 22.98 | 62.96 | 12.82 | 47.42 | |
2026.03 | 22.05 | 62.9 | 11.84 | 46.3 | |
2026.03 | 9.55 | 29.83 | 5.4 | 21.76 | |
2026.03 | 8.8 | 27.81 | 4.55 | 19.45 |