Code Generation on MBPP v1 (test)
68.9Pass@1
ChatGLM3-6B-Base
Updated 4d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2024.03 | 68.9 | - | |
2024.03 | 63 | - | |
2023.06 | 61.2 | - | |
2023.06 | 61.2 | - | |
2024.03 | 59.9 | - | |
2024.03 | 59.5 | - | |
2023.06 | 58.1 | - | |
2023.06 | 57 | - | |
2023.06 | 56.2 | - | |
2023.06 | 55 | - | |
2024.03 | 54.1 | - | |
2024.03 | 52.9 | - | |
2023.06 | 52.2 | - | |
2024.03 | 51.8 | - | |
2023.06 | 51.8 | - | |
2023.06 | 50 | - | |
2024.03 | 47.5 | - | |
2022.04 | 47 | - | |
2023.06 | 47 | - | |
2023.06 | 45.9 | - | |
2023.06 | 45 | - | |
2024.03 | 44 | - | |
2023.06 | 43.6 | - | |
2024.03 | 38.9 | - | |
2023.06 | 37.7 | - | |
2023.06 | 36.8 | - | |
2023.06 | 35.3 | - | |
2024.03 | 35 | - | |
2024.03 | 33.9 | - | |
2024.03 | 28.8 | - | |
2023.06 | 24.4 | - | |
2022.04 | 19.4 | - | |
2022.04 | 14.8 | - | |
2024.07 | - | 67.9 | |
2024.07 | - | 48.9 | |
2024.07 | - | 67.2 |