Code Helpfulness Evaluation on CVS (test)
0.66C++ Success Rate
Llama3-70b-instruct
Updated 4d ago
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
2024.06 | 0.66 | 0.57 | 0.67 | 0.69 | 0.7 | 0.658 | |
2024.06 | 0.62 | 0.58 | 0.6 | 0.64 | 0.68 | 0.624 | |
2024.06 | 0.52 | 0.55 | 0.53 | 0.53 | 0.42 | 0.51 | |
2024.06 | 0.5 | 0.5 | 0.5 | 0.5 | 0.5 | 0.5 | |
2024.06 | 0.5 | 0.5 | 0.49 | 0.49 | 0.39 | 0.474 | |
2024.06 | 0.38 | 0.38 | 0.42 | 0.515 | 0.43 | 0.425 | |
2024.06 | 0.35 | 0.33 | 0.4 | 0.52 | 0.44 | 0.408 | |
2024.06 | 0.28 | 0.61 | 0.63 | 0.596 | 0.74 | 0.571 |