Code Output Prediction on CRUXEval-O
49.8Pass@1
LoRA
Updated 4d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2024.05 | 49.8 | - | |
2024.02 | 48.6 | 61.6 | |
2024.05 | 48 | - | |
2024.02 | 47.1 | 59.5 | |
2024.05 | 44.8 | - | |
2024.05 | 44 | - | |
2024.02 | 43.5 | 54.8 | |
2024.05 | 42.5 | - | |
2024.05 | 42.5 | - | |
2024.02 | 42.4 | 55.9 | |
2024.05 | 41.5 | - | |
2024.05 | 41.2 | - | |
2024.05 | 40.5 | - | |
2024.05 | 39.8 | - | |
2024.02 | 39.7 | 53.9 | |
2024.05 | 39.5 | - | |
2024.05 | 39.5 | - | |
2024.05 | 39.5 | - | |
2024.05 | 37.2 | - | |
2024.05 | 37 | - | |
2024.02 | 36 | 52 | |
2024.05 | 36 | - | |
2024.05 | 35.2 | - | |
2024.05 | 34.8 | - | |
2024.05 | 34.5 | - | |
2024.02 | 34.2 | 48.4 | |
2024.02 | 34.2 | 48.4 | |
2024.02 | 34.2 | 47.1 | |
2024.05 | 34 | - | |
2024.05 | 33 | - | |
2024.05 | 33 | - | |
2024.02 | 32.2 | 44.9 | |
2024.05 | 32 | - | |
2024.05 | 31.5 | - | |
2024.05 | 31.5 | - | |
2024.05 | 31.2 | - | |
2024.02 | 31 | 43.4 | |
2024.05 | 29.8 | - | |
2024.05 | 28.5 | - | |
2024.02 | 27.4 | 40.9 | |
2024.02 | 26.7 | 43.5 | |
2024.05 | 19.5 | - | |
2024.05 | 18.5 | - | |
2024.05 | 18.2 | - | |
2024.05 | 15.8 | - | |
2024.05 | 15 | - | |
2024.05 | 13.2 | - |