Code Generation on MBPP (Pass@1, Pass@10)
41Pass@1
LLaMA3-8B
Updated 4d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.01 | 41 | 69 | |
2026.01 | 40.8 | 68.7 | |
2026.01 | 39 | 67.5 | |
2026.01 | 38.8 | 67.2 | |
2026.01 | 37 | 65 | |
2026.01 | 36.8 | 64.7 |
LLaMA3-8B
| Method | Links | ||
|---|---|---|---|
2026.01 | 41 | 69 | |
2026.01 | 40.8 | 68.7 | |
2026.01 | 39 | 67.5 | |
2026.01 | 38.8 | 67.2 | |
2026.01 | 37 | 65 | |
2026.01 | 36.8 | 64.7 |