Code Generation on HumanEval (Pass@4 Accuracy and GRPO Speedup)
77Accuracy (Pass@4)
DUET
Updated 22d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.05 | 77 | 2.38 | |
2026.05 | 77 | 1.43 | |
2026.05 | 75.2 | 0.63 | |
2026.05 | 75.2 | 0.75 | |
2026.05 | 73.6 | 1 | |
2026.05 | 73.6 | 1.19 | |
2026.05 | 62.8 | - | |
2026.05 | 53 | 0.95 | |
2026.05 | 52.9 | 2.04 | |
2026.05 | 52.8 | 1 | |
2026.05 | 52.8 | 1.13 | |
2026.05 | 52.7 | 1.62 | |
2026.05 | 52.7 | 0.82 | |
2026.05 | 52.1 | 1.26 | |
2026.05 | 51.7 | 2.51 | |
2026.05 | 50.5 | - | |
2026.05 | 48.9 | 0.95 | |
2026.05 | 47.7 | 1.3 | |
2026.05 | 47.6 | 1 | |
2026.05 | 46.8 | 0.81 | |
2026.05 | 34.5 | - |