Code Reasoning on CRUXEval (CoT Metrics)
73.8Input-CoT Accuracy
Qwen3-8B
Updated 4d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.01 | 73.8 | 76.9 | |
2026.01 | 69.5 | 79.5 | |
2026.01 | 65.8 | 65.9 | |
2026.01 | 63.3 | 67.1 | |
2026.01 | 62.1 | 69 | |
2026.01 | 61.3 | 63.5 | |
2026.01 | 60.6 | 66.4 | |
2026.01 | 56.5 | 57.8 | |
2026.01 | 56.5 | 56 | |
2026.01 | 53.8 | 60 | |
2026.01 | 53.4 | 46.1 | |
| 53 | 52.9 | ||
2026.01 | 52 | 54.8 | |
2026.01 | 50.6 | 48.8 | |
2026.01 | 49.4 | 43.9 | |
2026.01 | 47.5 | 55.6 | |
2026.01 | 47.3 | 50.6 | |
2026.01 | 46.1 | 47.6 | |
2026.01 | 45.5 | 60.9 | |
2026.01 | 44 | 38.8 | |
2026.01 | 43.3 | 43.9 | |
2026.01 | 42.6 | 45.1 | |
2026.01 | 39.9 | 43 | |
2026.01 | 39.5 | 35.1 | |
2026.01 | 39 | 41 | |
2026.01 | 36.1 | 36.2 | |
2026.01 | 35.6 | 37.8 |