Code Reasoning on MBPP (Accuracy, Token Cost)
67.3Accuracy
Denser
Updated 1mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2025.12 | 67.3 | -58.7 | |
2025.12 | 66.1 | 142.8 | |
2025.12 | 65.8 | 156.3 | |
2025.12 | 64.9 | 127.6 | |
2025.12 | 64.5 | 345.7 | |
2025.12 | 64.2 | -53.5 | |
2025.12 | 63.4 | 289.4 | |
2025.12 | 62.7 | 187.2 | |
2025.12 | 61.8 | 0 | |
2025.12 | 60.1 | -54.2 | |
2025.12 | 58.5 | -50.8 | |
2025.09 | 38.8 | - | |
2025.09 | 33.4 | - | |
2025.09 | 32.2 | - | |
2025.09 | 31.5 | - | |
2025.09 | 30.8 | - | |
2025.09 | 26.3 | - | |
2025.09 | 24.7 | - | |
2025.09 | 24.4 | - | |
2025.09 | 24 | - | |
2025.09 | 23.7 | - | |
2025.09 | 19.3 | - | |
2025.09 | 18.9 | - |