Code Generation on MBPP standard (test)
94.2Pass@1
QualityFlow
Updated 4d ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2025.01 | 94.2 | - | - | 4.8 | |
2025.01 | 89.4 | - | - | - | |
2024.05 | 61.98 | - | 79.95 | - | |
2024.05 | 61.78 | - | 79.96 | - | |
2024.05 | 61.63 | - | 80.27 | - | |
2024.05 | 61.59 | - | 80.21 | - | |
2024.05 | 58.19 | - | 77.96 | - | |
2024.05 | 58.07 | - | 77.34 | - | |
2024.05 | 58 | - | 78.12 | - | |
2024.05 | 57.98 | - | 77.92 | - | |
2024.05 | 57.92 | - | 78.97 | - | |
2024.05 | 57.35 | - | 78.12 | - | |
2024.05 | 57.11 | - | 76.7 | - | |
2024.05 | 56.66 | - | 75.78 | - | |
2024.05 | 52.43 | - | 73.66 | - | |
2024.05 | 51.19 | - | 73.16 | - | |
2024.05 | 49.97 | - | 76.39 | - | |
2024.05 | 49.68 | - | 75.85 | - | |
2024.05 | 48.87 | - | 70.89 | - | |
2024.05 | 48.62 | - | 70.68 | - | |
2024.05 | 47.41 | - | 70.27 | - | |
2024.05 | 46.54 | - | 71.54 | - | |
2024.05 | 43.98 | - | 71.94 | - | |
2024.05 | 43.42 | - | 72.09 | - | |
2024.05 | 42.88 | - | 70.85 | - | |
2024.05 | 40.64 | - | 71.04 | - | |
2024.05 | 40.37 | - | 71.6 | - | |
2024.05 | 38.21 | - | 67.24 | - | |
2024.05 | 37.7 | - | 69.6 | - | |
2024.05 | - | 27.2 | - | - | |
2024.05 | - | 37.1 | - | - | |
2024.05 | - | 39.7 | - | - | |
2024.05 | - | 41.1 | - | - | |
2024.05 | - | 37.9 | - | - | |
2024.05 | - | 50 | - | - | |
2024.05 | - | 48.7 | - | - | |
2024.05 | - | 48.7 | - | - |