Code Generation on HumanEval (MAT and Speedup)
8.53MAT Score
Graft
Updated 14d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.05 | 8.53 | 5.41 | |
2026.05 | 8.42 | 4.8 | |
2026.05 | 8.35 | 5.15 | |
2026.05 | 8.21 | 4.97 | |
2026.05 | 7.28 | 4.28 | |
2026.05 | 7.19 | 3.98 | |
2026.05 | 7.12 | 4.13 | |
2026.05 | 3.97 | 2.58 | |
2026.05 | 3.91 | 2.28 | |
2026.05 | 3.85 | 2.44 | |
2026.05 | 3.11 | 2.51 | |
2026.05 | 2.96 | 2.14 | |
2026.05 | 2.82 | 2.36 | |
2026.05 | 2.78 | 2.21 | |
2026.05 | 2.73 | 2.09 | |
2026.05 | 2.56 | 2.03 | |
2026.05 | 2.53 | 1.78 | |
2026.05 | 2.51 | 2.25 | |
2026.05 | 2.45 | 1.97 | |
2026.05 | 2.43 | 1.91 | |
2026.05 | 2.42 | 2.24 | |
2026.05 | 2.39 | 1.81 | |
2026.05 | 2.31 | 1.85 | |
2026.05 | 2.3 | 2.13 | |
2026.05 | 1.91 | 1.85 | |
2026.05 | 1.75 | 1.64 |