Scientific Reasoning on GPQA Diamond (Acc, Tok, CR, Cost)
65.2Accuracy
Vanilla
Updated 11d ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2026.04 | 65.2 | 8,447 | 100 | 8,447 | |
2026.04 | 65.2 | 8,098 | 95.9 | 8,433 | |
2026.04 | 58.3 | 6,355 | 75.2 | 6,533 | |
2026.04 | 56 | 3,763 | 44.5 | 3,799 | |
2026.04 | 55.8 | 9,536 | 100 | 9,536 | |
2026.04 | 55.8 | 9,424 | 98.8 | 9,825 | |
2026.04 | 54.1 | 6,865 | 72 | 10,371 | |
2026.04 | 53.8 | 3,128 | 37 | 3,159 | |
2026.04 | 53.2 | 7,318 | 100 | 7,318 | |
2026.04 | 53.2 | 7,243 | 99 | 7,558 | |
2026.04 | 53 | 6,412 | 67.2 | 6,496 | |
2026.04 | 52.8 | 6,064 | 63.6 | 6,144 | |
2026.04 | 52.8 | 6,804 | 93 | 11,142 | |
2026.04 | 51.7 | 5,883 | 80.4 | 5,967 | |
2026.04 | 50.9 | 5,634 | 77 | 5,715 | |
2026.04 | 49 | 6,459 | 67.7 | 6,670 | |
2026.04 | 49 | 6,334 | 86.6 | 6,535 | |
2026.04 | 47.5 | 9,056 | 98.7 | 18,243 | |
2026.04 | 47.4 | 9,177 | 100 | 9,177 | |
2026.04 | 47.4 | 9,178 | 100 | 9,527 | |
2026.04 | 47 | 8,032 | 87.5 | 8,468 | |
2026.04 | 46.9 | 7,898 | 86.1 | 8,318 | |
2026.04 | 45.7 | 7,948 | 86.6 | 8,375 | |
2026.04 | 44.7 | 830 | 9.8 | 1,060 | |
2026.04 | 39.1 | 947 | 9.9 | 1,210 | |
2026.04 | 33.9 | 1,231 | 16.8 | 1,656 | |
2026.04 | 33.3 | 2,629 | 28.6 | 4,394 |