Secure Code Generation on CVS (test)
98C++ Success Rate
Llama3-70b-instruct
Updated 4d ago
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
2024.06 | 98 | 94 | 90 | 98 | 94 | 94.8 | |
2024.06 | 91 | 95 | 90 | 97 | 90 | 92.6 | |
2024.06 | 83 | 93 | 86 | 90 | 92 | 88.8 | |
2024.06 | 75 | 100 | 90 | 96 | 91 | 90.4 | |
2024.06 | 63 | 83 | 97 | 88 | 95 | 85.2 | |
2024.06 | 43 | 84 | 91 | 93 | 98 | 81.8 | |
2024.06 | 35 | 63 | 84 | 88 | 93 | 72.6 | |
2024.06 | 31 | 90 | 87 | 85 | 93 | 77.2 |