Expert-level Reasoning on GPQA Diamond (Pass@1)
84.3Pass@1 Score
Gemma 4 31B
Updated 18d ago
Evaluation Results
| Method | Links | |
|---|---|---|
2026.07 | 84.3 | |
2026.07 | 82.3 | |
2026.07 | 78.8 | |
2026.07 | 58.6 | |
2026.05 | 50.51 | |
2026.05 | 48.48 | |
2026.05 | 43.43 | |
2026.07 | 43.4 | |
2026.07 | 42.4 | |
2025.08 | 38.9 | |
2025.08 | 33.6 | |
2025.08 | 33.6 | |
2026.05 | 29.8 | |
2026.05 | 29.29 | |
2026.05 | 28.6 | |
2026.05 | 28.28 | |
2026.05 | 22.9 | |
2025.08 | 19.7 | |
2026.05 | 19.2 | |
2025.08 | 0 |