Scientific Reasoning on GPQA Diamond (Acc, Tok, CR, Cost)
65.2Accuracy
Vanilla
Updated 23d ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2026.04 | 65.2 | 8,447 | 100 | 8,447 | |
2026.04 | 65.2 | 8,098 | 95.9 | 8,433 | |
2026.04 | 58.3 | 6,355 | 75.2 | 6,533 | |
2026.04 | 56 | 3,763 | 44.5 | 3,799 | |
2026.04 | 55.8 | 9,536 | 100 | 9,536 | |
2026.04 | 55.8 | 9,424 | 98.8 | 9,825 | |
2026.04 | 54.1 | 6,865 | 72 | 10,371 | |
2026.04 | 53.8 | 3,128 | 37 | 3,159 | |
2026.04 | 53.2 | 7,318 | 100 | 7,318 | |
2026.04 | 53.2 | 7,243 | 99 | 7,558 | |
2026.04 | 53 | 6,412 | 67.2 | 6,496 | |
2026.04 | 52.8 | 6,064 | 63.6 | 6,144 | |
2026.04 | 52.8 | 6,804 | 93 | 11,142 | |
2026.04 | 51.7 | 5,883 | 80.4 | 5,967 | |
2026.04 | 50.9 | 5,634 | 77 | 5,715 | |
2026.04 | 49 | 6,459 | 67.7 | 6,670 | |
2026.04 | 49 | 6,334 | 86.6 | 6,535 | |
2026.04 | 47.5 | 9,056 | 98.7 | 18,243 | |
2026.04 | 47.4 | 9,177 | 100 | 9,177 | |
2026.04 | 47.4 | 9,178 | 100 | 9,527 | |
2026.05 | 47.2 | 2,870.9 | - | - | |
2026.04 | 47 | 8,032 | 87.5 | 8,468 | |
2026.04 | 46.9 | 7,898 | 86.1 | 8,318 | |
2026.04 | 45.7 | 7,948 | 86.6 | 8,375 | |
2026.04 | 44.7 | 830 | 9.8 | 1,060 | |
2026.05 | 44.1 | 3,492.9 | - | - | |
2026.05 | 40.8 | 4,295.6 | - | - | |
2026.05 | 40.3 | 6,491.1 | - | - | |
2026.04 | 39.1 | 947 | 9.9 | 1,210 | |
2026.05 | 38.3 | 5,225 | - | - | |
2026.05 | 37.9 | 5,431.5 | - | - | |
2026.05 | 35.2 | 7,288.7 | - | - | |
2026.04 | 33.9 | 1,231 | 16.8 | 1,656 | |
2026.04 | 33.3 | 2,629 | 28.6 | 4,394 | |
2026.05 | 25.4 | 3,259.4 | - | - | |
2026.05 | 25 | 5,324 | - | - | |
2026.05 | 24.4 | 4,013.8 | - | - | |
2026.05 | 23.9 | 6,566.8 | - | - | |
2026.05 | 23 | 5,285.2 | - | - | |
2026.05 | 21.8 | 5,136.9 | - | - | |
2026.05 | 16 | 8,514.3 | - | - |