Code Generation on HumanEval (MAT, Speed)
9.48MAT
TALON
Updated 1mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.01 | 9.48 | 5.16 | |
2026.01 | 8.31 | 4.77 | |
2026.01 | 8.21 | 4.35 | |
2026.01 | 7.28 | 4.2 | |
2026.01 | 7.08 | 4.05 | |
2026.01 | 6.7 | 3.85 | |
2026.01 | 6.28 | 3.96 | |
2026.01 | 3.89 | 2.35 | |
2026.01 | 3.87 | 2.67 | |
2026.01 | 3.78 | 2.69 | |
2026.01 | 2.98 | 1.96 | |
2026.01 | 2.96 | 2.15 | |
2026.01 | 2.86 | 1.47 | |
2026.01 | 2.78 | 2.18 |