Code Input Prediction on CRUXEval-I
50Pass@1
LoPA
Updated 4d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2024.05 | 50 | - | |
2024.02 | 48.1 | 66.9 | |
2024.05 | 47.5 | - | |
2024.02 | 47.2 | 66.6 | |
2024.02 | 46.5 | 64.9 | |
2024.05 | 45.8 | - | |
2024.05 | 45.5 | - | |
2024.05 | 45 | - | |
2024.05 | 43 | - | |
2024.05 | 43 | - | |
2024.02 | 42.5 | 62 | |
2024.05 | 42.2 | - | |
2024.02 | 41.9 | 62.7 | |
2024.05 | 41.5 | - | |
2024.05 | 41.2 | - | |
2024.05 | 41.2 | - | |
2024.05 | 40.5 | - | |
2024.05 | 40.2 | - | |
2024.05 | 39.3 | - | |
2024.05 | 39.2 | - | |
2024.05 | 38 | - | |
2024.05 | 37.5 | - | |
2024.02 | 35.9 | 52.9 | |
2024.05 | 35.5 | - | |
2024.05 | 35 | - | |
2024.05 | 35 | - | |
2024.02 | 34.6 | 53.5 | |
2024.05 | 34.5 | - | |
2024.05 | 33.8 | - | |
2024.02 | 33.5 | 53.3 | |
2024.05 | 33.5 | - | |
2024.05 | 33.5 | - | |
2024.05 | 33 | - | |
2024.05 | 32.8 | - | |
2024.02 | 32.7 | 50.1 | |
2024.02 | 31.3 | 49.2 | |
2024.05 | 31 | - | |
2024.05 | 31 | - | |
2024.02 | 29.7 | 47.3 | |
2024.05 | 29.2 | - | |
2024.02 | 27.8 | 44.7 | |
2024.02 | 27.1 | 43.7 | |
2024.05 | 27 | - | |
2024.05 | 26.8 | - | |
2024.05 | 26 | - | |
2024.05 | 20.8 | - | |
2024.05 | 16.9 | - |