Code Generation on MBPP (pass@1, Precision(h), Recall(h), F1(h))
34.2Pass@1
SemStamp
Updated 2d ago
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
2026.01 | 34.2 | 66.9 | 71.8 | 69.2 | 61.7 | 0.6 | 0.8 | |
2026.01 | 33.8 | - | - | - | - | - | - | |
2026.01 | 33.6 | 76 | 86 | 80.7 | 79.4 | 0 | 86 | |
2026.01 | 33.2 | 79.5 | 62.3 | 70.2 | 74.8 | 12.4 | 24 | |
2026.01 | 15 | 87.5 | 31 | 45.7 | 71.2 | 8 | 17 |