Code Generation on MBPP (Accuracy, Cost, Latency)
86.7Accuracy
Oracle
Updated 4d ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2026.01 | 86.7 | - | - | |
2026.01 | 79.8 | - | - | |
2026.01 | 79.8 | 0.37 | 7.31 | |
2026.01 | 79.4 | 0.18 | 10.3 | |
2026.01 | 76.3 | - | - | |
2026.01 | 75.5 | 0.61 | 15.52 | |
2026.01 | 72.6 | - | - | |
2026.01 | 66.2 | - | - | |
2026.01 | 63 | - | - | |
2026.01 | 52.9 | - | - | |
2026.01 | 16 | - | - |