Code Generation on MBPP (Pass@1 Python, Pass@1 Rust)
96.5Pass@1 Accuracy (Python)
SYMPHONY-L
Updated 1mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.01 | 96.5 | 97.4 | |
2026.01 | 92.7 | 94.6 | |
2026.01 | 91.8 | - | |
2026.01 | 91 | - | |
2026.01 | 89 | - | |
2026.01 | 87.7 | - | |
2026.01 | 81.1 | - | |
2026.01 | 80 | 71 | |
2026.01 | 77.1 | 75.4 | |
2026.01 | 71.4 | - | |
2026.01 | 71 | - | |
2026.01 | 68.3 | - |