Code Generation on HumanEval (Pass@k, AUC, and Token Usage)
94.1Pass@1
ExPairT-LLM
Updated 3d ago
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
2025.11 | 94.1 | - | - | - | - | |
2025.11 | 92.85 | - | - | - | - | |
2026.01 | 92.1 | - | - | - | - | |
2025.11 | 91.7 | - | - | - | - | |
2026.01 | 91.6 | - | - | - | - | |
2025.11 | 91.6 | - | - | - | - | |
2025.11 | 91.46 | - | - | - | - | |
2025.11 | 91.3 | - | - | - | - | |
2026.01 | 91.1 | - | - | - | - | |
2025.11 | 90.42 | - | - | - | - | |
2026.01 | 90.3 | - | - | - | - | |
2026.01 | 90.1 | - | - | - | - | |
2026.01 | 89.8 | - | - | - | - | |
2025.11 | 89.32 | - | - | - | - | |
2025.11 | 89.29 | - | - | - | - | |
2026.01 | 89.1 | - | - | - | - | |
2026.01 | 89.1 | - | - | - | - | |
2025.11 | 89.1 | - | - | - | - | |
2025.11 | 88.8 | - | - | - | - | |
2025.11 | 88.68 | - | - | - | - | |
2025.11 | 88.6 | - | - | - | - | |
2025.11 | 88.13 | - | - | - | - | |
2025.11 | 87.5 | - | - | - | - | |
2025.11 | 87.49 | - | - | - | - | |
2025.11 | 87.08 | - | - | - | - | |
2025.11 | 84.57 | - | - | - | - | |
2025.11 | 80.9 | - | - | - | - | |
2025.11 | 80.8 | - | - | - | - | |
2025.11 | 80.5 | - | - | - | - | |
2026.01 | 76.63 | - | - | - | - | |
2025.11 | 74.1 | - | - | - | - | |
2025.11 | 70.5 | - | - | - | - | |
2025.11 | 66.6 | - | - | - | - | |
2025.11 | 65.4 | - | - | - | - | |
2025.11 | 65.4 | - | - | - | - | |
2025.11 | 64 | - | - | - | - | |
2025.11 | 62.5 | - | - | - | - | |
2026.01 | 61.71 | - | - | - | - | |
2026.01 | 57.1 | 80.5 | 83.5 | 73.2 | 5.8 | |
2026.01 | 56.4 | 79.8 | 82.5 | 71.2 | 5.9 | |
2026.01 | 56.2 | 79.2 | 82 | 71.8 | 6 | |
2026.01 | 56.1 | 81.1 | 84.2 | 73.5 | 4.6 | |
2026.01 | 55.3 | 78.5 | 81.8 | 70.8 | 4.4 | |
2025.11 | 55.1 | - | - | - | - | |
2026.01 | 55 | 76.8 | 79.5 | 69.5 | 6 | |
2026.01 | 52.8 | 74.5 | 77.8 | 67.2 | 3.6 | |
2026.01 | 49.4 | - | - | - | - | |
2026.02 | 47.67 | - | - | - | - | |
2026.02 | 46.48 | - | - | - | - | |
2026.01 | 45.7 | 67.8 | 71.2 | 60.3 | 1.6 | |
2026.01 | 45.12 | - | - | - | - | |
2025.11 | 42.4 | - | - | - | - | |
2026.02 | 42.08 | - | - | - | - | |
2026.02 | 40.64 | - | - | - | - | |
2025.11 | 40.3 | - | - | - | - | |
2026.01 | 39.6 | - | - | - | - | |
2026.02 | 39.37 | - | - | - | - | |
2026.02 | 39.19 | - | - | - | - | |
2025.11 | 38.7 | - | - | - | - | |
2026.02 | 38.46 | - | - | - | - | |
2026.02 | 38.14 | - | - | - | - | |
2026.02 | 37.98 | - | - | - | - | |
2026.02 | 37.8 | - | - | - | - | |
2025.11 | 37.6 | - | - | - | - | |
2026.02 | 36.86 | - | - | - | - | |
2026.02 | 35.95 | - | - | - | - | |
2026.02 | 34.71 | - | - | - | - | |
2026.02 | 33.69 | - | - | - | - | |
2026.02 | 33.5 | - | - | - | - | |
2026.02 | 33.39 | - | - | - | - | |
2026.02 | 32.74 | - | - | - | - | |
2026.02 | 32.63 | - | - | - | - | |
2026.01 | 32.3 | - | - | - | - | |
2026.02 | 32.17 | - | - | - | - | |
2026.02 | 31.63 | - | - | - | - | |
2026.02 | 31.63 | - | - | - | - | |
2026.02 | 31.46 | - | - | - | - | |
2026.02 | 31.18 | - | - | - | - | |
2026.02 | 31.15 | - | - | - | - | |
2026.02 | 31.03 | - | - | - | - | |
2026.02 | 30.57 | - | - | - | - | |
2026.02 | 30.28 | - | - | - | - | |
2026.02 | 30.26 | - | - | - | - | |
2026.02 | 29.94 | - | - | - | - | |
2026.02 | 29.73 | - | - | - | - | |
2026.02 | 29.41 | - | - | - | - | |
2026.02 | 29.31 | - | - | - | - | |
2026.02 | 29.3 | - | - | - | - | |
2026.02 | 29.05 | - | - | - | - | |
2026.02 | 28.95 | - | - | - | - | |
2026.02 | 28.52 | - | - | - | - | |
2026.02 | 27.81 | - | - | - | - | |
2026.02 | 27.14 | - | - | - | - | |
2026.02 | 26.86 | - | - | - | - | |
2026.02 | 26.83 | - | - | - | - | |
2026.02 | 25.65 | - | - | - | - | |
2026.02 | 25.63 | - | - | - | - | |
2026.02 | 25.15 | - | - | - | - | |
2026.02 | 25.13 | - | - | - | - | |
2026.02 | 23.94 | - | - | - | - |
Showing 100 of 108 rows