Code Generation on TACO Verified
96.3During-task Accuracy
Cloud LLM Cluster
Updated 1mo ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2026.01 | 96.3 | 96.3 | - | |
| 84.8 | 72.8 | 14.1 | ||
| 82.2 | 66.6 | 19 | ||
| 76.9 | 60.2 | 21.7 | ||
2026.01 | 75.8 | 61.2 | 19.2 | |
| 74.4 | 62.3 | 16.2 | ||
| 71.6 | 58.9 | 17.7 | ||
| 70.4 | 54.2 | 23 | ||
2026.01 | 69.8 | 56.7 | 18.7 | |
2026.01 | 69.7 | 58.6 | 15.9 | |
2026.01 | 66.8 | 54.8 | 17.9 | |
| 66.7 | 54.6 | 18.1 | ||
| 65.8 | 48.5 | 26.3 | ||
| 61.6 | 43.1 | 29.1 | ||
| 60.8 | 48.9 | 19.6 | ||
| 57.4 | 39.5 | 31.2 | ||
| 56.5 | 44 | 22.1 | ||
2026.01 | 55.2 | 38.2 | 30.8 | |
| 51.8 | 34.6 | 33.2 | ||
| 51.1 | 37.8 | 26 | ||
| 50.9 | 37.6 | 26.1 | ||
2026.01 | 48.1 | 34.2 | 28.9 | |
| 46.6 | 33.1 | 29 | ||
2026.01 | 44 | 24 | 45.5 | |
2026.01 | 44 | 24 | 45.5 | |
2026.01 | 43.7 | 24.2 | 44.6 | |
2026.01 | 42.7 | 29.9 | 30 | |
2026.01 | 42.7 | 29.9 | 30 | |
2026.01 | 42.5 | 30.1 | 29.2 |