Code Reasoning on CRUXEval (CoT Metrics)
98.8Input-CoT Accuracy
Gemini-3-Pro-preview
Updated 1mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.03 | 98.8 | 99.1 | |
2026.03 | 98.4 | 98 | |
2026.03 | 96.5 | 97.6 | |
2026.03 | 96.2 | 96.2 | |
2026.03 | 93.5 | 87 | |
2026.03 | 92.2 | 86.2 | |
| 91.1 | 85.5 | ||
2026.03 | 87.4 | 94 | |
| 87.1 | 90.4 | ||
2026.03 | 86.8 | 89.5 | |
2026.03 | 82.1 | 94.2 | |
2026.03 | 80.5 | 90.6 | |
2026.03 | 78.8 | 84 | |
2026.03 | 76.9 | 80.5 | |
| 76.5 | 75.2 | ||
2026.03 | 75.6 | 79.2 | |
2026.01 | 73.8 | 76.9 | |
2026.03 | 71.4 | 81.1 | |
2026.03 | 70.8 | 71.1 | |
2026.01 | 69.5 | 79.5 | |
2026.03 | 66.9 | 66 | |
2026.01 | 65.8 | 65.9 | |
2026.03 | 65.6 | 81.2 | |
2026.01 | 63.3 | 67.1 | |
2026.01 | 62.1 | 69 | |
2026.03 | 62 | 66.6 | |
| 62 | 89.5 | ||
2026.01 | 61.3 | 63.5 | |
2026.01 | 60.6 | 66.4 | |
2026.03 | 57.6 | 81.5 | |
| 57.1 | 56.2 | ||
2026.01 | 56.5 | 57.8 | |
2026.01 | 56.5 | 56 | |
2026.01 | 53.8 | 60 | |
2026.01 | 53.4 | 46.1 | |
| 53 | 52.9 | ||
2026.03 | 52.6 | 57.6 | |
2026.01 | 52 | 54.8 | |
2026.01 | 50.6 | 48.8 | |
2026.01 | 49.4 | 43.9 | |
2026.01 | 47.5 | 55.6 | |
2026.01 | 47.3 | 50.6 | |
2026.01 | 46.1 | 47.6 | |
2026.03 | 45.8 | 54.2 | |
2026.01 | 45.5 | 60.9 | |
2026.01 | 44 | 38.8 | |
2026.01 | 43.3 | 43.9 | |
2026.01 | 42.6 | 45.1 | |
2026.03 | 42.5 | 65.1 | |
2026.01 | 39.9 | 43 | |
2026.01 | 39.5 | 35.1 | |
2026.01 | 39 | 41 | |
2026.01 | 36.1 | 36.2 | |
2026.01 | 35.6 | 37.8 | |
2026.03 | 33 | 64.2 | |
| 15.2 | 46.9 |