Code Generation on BigCodeBench (30% held-out tasks)
55.8Success Rate (SR)
APEX-EM (A5: Opus judge)
Updated 17d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.03 | 55.8 | 9.9 | |
2026.03 | 53.5 | 9.9 | |
2026.03 | 51.5 | 5.6 | |
2026.03 | 51.2 | 5.3 | |
2026.03 | 50.8 | 2.3 | |
| 50.6 | 4.7 | ||
2026.03 | 50.3 | 4.4 | |
2026.03 | 50 | 1.5 | |
2026.03 | 49.4 | 0.9 | |
| 48.8 | 2.9 | ||
2026.03 | 48.5 | - | |
2026.03 | 48.5 | 0 | |
2026.03 | 47.9 | 0.6 | |
2026.03 | 46.5 | 0.6 | |
2026.03 | 45.9 | - |