Uncertainty Estimation on SimpleQA
61.3AUROC
P(YES) (top right)
Updated 3mo ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2025.06 | 61.3 | 17.8 | 18.8 | |
2025.06 | 61.2 | 26.1 | 18.2 | |
2025.06 | 59.8 | 17.8 | 69.9 | |
2025.06 | 57.6 | 16.6 | 4 | |
2025.06 | 56 | 13.2 | 10.3 | |
2025.06 | 55.6 | 11.6 | 67.4 | |
2025.06 | 55.6 | 11.4 | 35.5 | |
2025.06 | 54.9 | 5.8 | 28.5 | |
2025.06 | 54 | 5.9 | - | |
2025.06 | 53.8 | 13.2 | - | |
2025.06 | 53.6 | 5.2 | 78.9 | |
2025.06 | 52.4 | 5.8 | - | |
2025.06 | 51.8 | 8.1 | - | |
2025.06 | 50.8 | -1.2 | - | |
2025.06 | 50.5 | 5.5 | - | |
2025.06 | 50.5 | 1.3 | - | |
2025.06 | 50.1 | 5.1 | - | |
2025.06 | 50.1 | -2.9 | - | |
2025.06 | 50.1 | -3.8 | - | |
2025.06 | 50.1 | -2.4 | - | |
2025.06 | 49.8 | 0.1 | - | |
2025.06 | 49.1 | -0.9 | - | |
2025.06 | 48.7 | -2.9 | - | |
2025.06 | 48.6 | -4.2 | - |