Code Generation on MBPP (Acc@t1, Acc@t2, Δ(t1,t2))
66.2Accuracy @ t1
Prompt based
Updated 4d ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2025.05 | 66.2 | - | - | |
2025.05 | 66.2 | 71 | 4.8 | |
2025.05 | 66.2 | 73 | 6.8 | |
2025.05 | 65.4 | 69.4 | 4 | |
2025.05 | 65.4 | 69.2 | 3.8 | |
2025.05 | 63 | - | - | |
2025.05 | 63 | 68 | 5 | |
2025.05 | 63 | 68 | 5 | |
2025.05 | 54.4 | 59.2 | 4.8 | |
2025.05 | 54.4 | 59.6 | 5.2 | |
2025.05 | 54.4 | 57.8 | 3.4 | |
2025.05 | 54.4 | 56.8 | 2.4 | |
2025.05 | 54.4 | 58.6 | 4.2 | |
2025.05 | 54.4 | 59.4 | 5 | |
2025.05 | 37 | - | - | |
2025.05 | 31.2 | - | - | |
2025.05 | 28.4 | - | - | |
2025.05 | 28.4 | 44 | 15.6 | |
2025.05 | 28.4 | 29.6 | 1.2 | |
2025.05 | 28.4 | 42.4 | 14 | |
2025.05 | 28.4 | 48.8 | 20.4 | |
2025.05 | 28.4 | 47.4 | 19 | |
2025.05 | 20.4 | - | - | |
2025.05 | 20.4 | 23 | 2.6 | |
2025.05 | 20.4 | 24 | 3.6 | |
2025.05 | 20.4 | 20.8 | 0.4 | |
2025.05 | 20.4 | 23.2 | 2.8 | |
2025.05 | 20.4 | 22.6 | 2.2 | |
2025.05 | 17 | - | - |