Code Generation on MBPP+ (Accuracy, TPS, Speedup)
170.9TPS (tok/s)
PARSE + EAGLE3
Updated 7d ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2026.05 | 170.9 | - | 1.97 | - | |
2026.05 | 152.6 | - | 1.76 | - | |
2026.05 | 148.1 | 74.6 | 1.7 | - | |
2026.05 | 110.8 | 73.8 | 1.7 | - | |
2026.05 | 86.9 | 79.9 | - | - | |
2026.05 | 65.3 | 78 | - | - | |
2026.05 | - | 66.9 | - | - | |
2026.05 | - | 69.3 | - | - | |
2026.05 | - | - | - | 0.5423 | |
2026.05 | - | - | - | 0.7778 | |
2026.05 | - | - | - | 0.7857 |