Python Program Synthesis on MBPP (test)
55.8Accuracy
DAWN + AXON
Updated 1mo ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2026.06 | 55.8 | 30.09 | 42.6 | |
2026.06 | 55.6 | 28.47 | 41.4 | |
2026.06 | 55.4 | 25.19 | 56 | |
2026.06 | 55.4 | 29.76 | 42.8 | |
2026.06 | 55.2 | 26.38 | 62.7 | |
2026.06 | 55.2 | 24.98 | 55.1 | |
2026.06 | 55 | 28.25 | 40.6 | |
2026.06 | 55 | 29.89 | 41.8 | |
2026.06 | 54.6 | 28.69 | 44.7 | |
2026.06 | 54.2 | 5.42 | 256 | |
2026.06 | 39.2 | 14.39 | 42.2 | |
2026.06 | 38.8 | 2.39 | 256 | |
2026.06 | 38.8 | 18.5 | 32.5 | |
2026.06 | 38.2 | 14.52 | 42.1 | |
2026.06 | 38.2 | 16.77 | 35.3 | |
2026.06 | 38 | 14.11 | 42.5 | |
2026.06 | 37.8 | 19.37 | 30.7 | |
2026.06 | 37.6 | 17.13 | 34.6 | |
2026.06 | 37.2 | 20.97 | 29.3 | |
2026.06 | 37.2 | 21.49 | 28.3 | |
2026.06 | 32.4 | 31.69 | 44.4 | |
2026.06 | 32 | 23.51 | 62.2 | |
2026.06 | 31.4 | 23.69 | 61.6 | |
2026.06 | 31.4 | 28.05 | 51.5 | |
2026.06 | 30.8 | 31.19 | 50 | |
2026.06 | 30.6 | 32.35 | 42.4 | |
2026.06 | 30.2 | 28.61 | 50.6 | |
2026.06 | 29.6 | 23.69 | 69.8 | |
2026.06 | 29.4 | 6.48 | 256 | |
2026.06 | 29.4 | 29.84 | 55 |