Scientific Reasoning on GPQA diamond (ACC, TOK, LAT)
4.43Latency
CoT
Updated 21d ago
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
2025.07 | 4.43 | - | - | - | 9.91 | - | |
2025.07 | 7.29 | - | - | - | 21.81 | -21.57 | |
2025.07 | 8.14 | - | - | - | 26.66 | 11.2 | |
2025.07 | 8.57 | - | - | - | 15.63 | - | |
2025.07 | 9.89 | - | - | - | 16.8 | -35.81 | |
2025.07 | 10.03 | - | - | - | 23.55 | -19.83 | |
2025.07 | 10.63 | - | - | - | 15.46 | - | |
2025.07 | 10.96 | - | - | - | 17.75 | 2.29 | |
2025.07 | 12.11 | - | - | - | 16.94 | 1.48 | |
2025.07 | 13.61 | - | - | - | 34.45 | -8.93 | |
2025.07 | 17.62 | - | - | - | 22.41 | -30.2 | |
2025.07 | 20.13 | - | - | - | 45.38 | - | |
2025.07 | 20.98 | - | - | - | 38.41 | -20.81 | |
2025.07 | 21.11 | - | - | - | 37.37 | -15.24 | |
2025.07 | 21.98 | - | - | - | 37.26 | -21.96 | |
2025.07 | 23.79 | - | - | - | 58.06 | -36.95 | |
2025.07 | 25.31 | - | - | - | 34.11 | -60.24 | |
2025.07 | 30.14 | - | - | - | 43.38 | - | |
2025.07 | 31.82 | - | - | - | 52.61 | - | |
2025.07 | 32.6 | - | - | - | 78.8 | -0.07 | |
2025.07 | 36.23 | - | - | - | 59.94 | -35.07 | |
2025.07 | 37.45 | - | - | - | 72.22 | -6.65 | |
2025.07 | 37.66 | - | - | - | 62.78 | -31.57 | |
2025.07 | 40.23 | - | - | - | 77.09 | -1.78 | |
2025.07 | 40.34 | - | - | - | 47.86 | -11.36 | |
2025.07 | 41.22 | - | - | - | 163.97 | -76.13 | |
2025.07 | 42.78 | - | - | - | 59.22 | - | |
2025.07 | 47.08 | - | - | - | 78.87 | - | |
2025.07 | 47.31 | - | - | - | 114.81 | -92.39 | |
2025.07 | 48.56 | - | - | - | 160.16 | -79.94 | |
2026.02 | 49.87 | 35.46 | 8.69 | - | - | - | |
2026.02 | 49.87 | 35.46 | 8.69 | - | - | - | |
2025.07 | 51.05 | - | - | - | 96.38 | 2.03 | |
2025.07 | 52.68 | - | - | - | 91.93 | -3.08 | |
2025.07 | 60.86 | - | - | - | 113.52 | -93.68 | |
2025.07 | 70.48 | - | - | - | 137.16 | -70.04 | |
2026.02 | 74.31 | 32.31 | 11.77 | - | - | - | |
2026.02 | 74.31 | 32.31 | 11.77 | - | - | - | |
2025.07 | 79.32 | - | - | - | 207.2 | - | |
2025.07 | 84.37 | - | - | - | 240.1 | - | |
2025.07 | 85.27 | - | - | - | 95.01 | - | |
2025.07 | 86.06 | - | - | - | 94.35 | - | |
2025.07 | 91.84 | - | - | - | 207.32 | -32.78 | |
2026.02 | 101.84 | 29.4 | 10.45 | - | - | - | |
2026.02 | 101.84 | 29.4 | 10.45 | - | - | - | |
2026.02 | 149.93 | 37.5 | 24.27 | - | - | - | |
2026.02 | 149.93 | 37.5 | 24.27 | - | - | - | |
2026.02 | 156.09 | 48.17 | 7.58 | - | - | - | |
2026.02 | 166.54 | 44.65 | 8.05 | - | - | - | |
2026.02 | 197.33 | 29.81 | 15.48 | - | - | - | |
2026.02 | 197.33 | 29.81 | 15.48 | - | - | - | |
2026.02 | 254.73 | 45.65 | 8.1 | - | - | - | |
2026.02 | 272.24 | 48.99 | 11.89 | - | - | - | |
2026.02 | 579.22 | 47.02 | 12.32 | - | - | - | |
2026.02 | - | 82.4 | - | - | - | - | |
2026.02 | - | 86.4 | - | - | - | - | |
2026.02 | - | 85.7 | - | - | - | - | |
2026.02 | - | 91.9 | - | - | - | - | |
2026.02 | - | 86.36 | - | - | - | - | |
2026.02 | - | 87.6 | - | 14,000 | - | - | |
2026.02 | - | 84.5 | - | 13,000 | - | - | |
2026.02 | - | 91.9 | - | 8,000 | - | - | |
2026.02 | - | 82.4 | - | 7,000 | - | - | |
2025.07 | - | 26.26 | 1,086 | - | - | - | |
2025.07 | - | 38.89 | 6,032 | - | - | - | |
2025.07 | - | 39.39 | 5,819 | - | - | - | |
2025.07 | - | 38.38 | 7,678 | - | - | - | |
2025.07 | - | 39.9 | 5,231 | - | - | - | |
2025.07 | - | 39.9 | 612 | - | - | - | |
2025.07 | - | 51.01 | 6,547 | - | - | - | |
2025.07 | - | 52.53 | 5,561 | - | - | - | |
2025.07 | - | 53.53 | 8,024 | - | - | - | |
2025.07 | - | 54.04 | 4,801 | - | - | - | |
2025.07 | - | 39.9 | 859 | - | - | - | |
2025.07 | - | 56.06 | 6,910 | - | - | - | |
2025.07 | - | 55.05 | 6,579 | - | - | - | |
2025.07 | - | 54.04 | 8,726 | - | - | - | |
2025.07 | - | 57.58 | 6,147 | - | - | - | |
2025.07 | - | 49.49 | 855 | - | - | - | |
2025.07 | - | 32.83 | 1,574 | - | - | - |