Code Generation on MBPP+ (Pass@1, Avg, ΔScore)
73.75Pass@1
R1-Oracle
Updated 6d ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2026.03 | 73.75 | 79.12 | 0 | |
2026.05 | 72.6 | - | - | |
2026.05 | 72 | - | - | |
2026.05 | 71.6 | - | - | |
2026.05 | 70.9 | - | - | |
2026.05 | 70.7 | - | - | |
2026.05 | 70.6 | - | - | |
2026.05 | 70.2 | - | - | |
2026.05 | 69.8 | - | - | |
2026.05 | 69.6 | - | - | |
2026.05 | 68.8 | - | - | |
2026.05 | 68.3 | - | - | |
2026.05 | 67.72 | - | - | |
2026.05 | 67.5 | - | - | |
2026.05 | 67.5 | - | - | |
2026.05 | 66.75 | - | - | |
2026.05 | 65.3 | - | - | |
2026.03 | 65 | 75.67 | -3.45 | |
2026.03 | 63.75 | 77.02 | -2.1 | |
2026.03 | 56.25 | 70.47 | 0 | |
2026.03 | 55 | 62.72 | -7.75 | |
2026.03 | 55 | 68.1 | -2.37 | |
2026.05 | 54.5 | - | - | |
2026.05 | 51.95 | - | - | |
2026.05 | 51.95 | - | - | |
2026.05 | 51.9 | - | - | |
2026.05 | 51.59 | - | - | |
2026.05 | 51.17 | - | - | |
2026.05 | 50.5 | - | - | |
2026.05 | 50.39 | - | - | |
2026.05 | 50.39 | - | - | |
2026.05 | 50.39 | - | - | |
2026.05 | 50.26 | - | - | |
2026.05 | 50.26 | - | - | |
2026.05 | 50 | - | - | |
2026.05 | 50 | - | - | |
2026.05 | 49.97 | - | - | |
2026.05 | 49.61 | - | - | |
2026.05 | 49.61 | - | - | |
2026.05 | 49.47 | - | - |