Code Generation on MBPP Plus (test)
83.6Accuracy
Team-of-Thoughts
Updated 4d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.02 | 83.6 | - | |
2026.02 | 83.33 | - | |
2026.02 | 81.48 | - | |
2026.02 | 80.69 | - | |
2026.02 | 79.37 | - | |
2026.02 | 77.51 | - | |
2026.02 | 76.46 | - | |
2025.02 | 76.2 | 6.71 | |
2025.02 | 75.1 | - | |
2025.02 | 74.3 | - | |
2025.02 | 71.7 | - | |
2025.02 | 71.4 | - | |
2023.12 | 70.7 | - | |
2025.02 | 70.4 | 3.03 | |
2025.02 | 69.8 | 4.76 | |
2023.12 | 69.4 | - | |
2026.02 | 69.31 | - | |
2025.02 | 69 | - | |
2025.02 | 68.8 | - | |
2025.02 | 68.8 | - | |
2025.02 | 68.3 | - | |
2025.02 | 68 | - | |
2025.02 | 67.5 | - | |
2025.02 | 66.9 | 1.56 | |
2025.02 | 66.7 | - | |
2025.02 | 66.7 | - | |
2025.02 | 66.1 | - | |
2025.02 | 66.1 | - | |
2025.02 | 65.9 | - | |
2025.02 | 65.3 | - | |
2026.02 | 63.49 | - | |
2023.12 | 62.7 | - | |
2023.12 | 61.7 | - | |
2023.12 | 60.7 | - | |
2023.12 | 59.9 | - | |
2023.12 | 59.4 | - | |
2025.02 | 57.4 | 1.43 | |
2025.02 | 57.4 | - | |
2025.02 | 56.9 | - | |
2023.12 | 56.6 | - | |
2025.02 | 56.6 | - | |
2025.02 | 56.6 | - | |
2023.12 | 52.9 | - | |
2023.12 | 50.9 | - | |
2026.02 | 49.5 | - | |
2026.02 | 49.2 | - | |
2026.02 | 48.1 | - | |
2023.12 | 47.1 | - | |
2026.02 | 46.3 | - | |
2023.12 | 46.1 | - | |
2026.02 | 45.5 | - | |
2023.12 | 45.4 | - | |
2026.02 | 45.2 | - | |
2023.12 | 44.4 | - | |
2026.02 | 44.4 | - | |
2023.12 | 43.6 | - | |
2026.02 | 42.1 | - | |
2024.05 | 42 | - | |
2024.05 | 42 | - | |
2026.02 | 41.8 | - | |
2026.02 | 41.8 | - | |
2026.02 | 41.8 | - | |
2026.02 | 41.3 | - | |
2026.02 | 41 | - | |
2023.12 | 40.9 | - | |
2024.05 | 40.6 | - | |
2026.02 | 38.4 | - | |
2026.02 | 36 | - | |
2026.02 | 36 | - | |
2026.02 | 34.9 | - | |
2024.05 | 34.4 | - | |
2024.05 | 33.9 | - | |
2026.02 | 33.6 | - | |
2026.02 | 32.5 | - | |
2024.05 | 32.1 | - | |
2024.05 | 31.7 | - | |
2026.02 | 29.6 | - | |
2026.02 | 29.4 | - | |
2023.12 | 28.8 | - | |
2026.02 | 28 | - | |
2026.02 | 25.9 | - | |
2026.02 | 25.4 | - | |
2026.02 | 25.1 | - | |
2024.05 | 25 | - | |
2026.02 | 24.1 | - | |
2026.02 | 23.3 | - | |
2026.02 | 22 | - |