Confidence Calibration on SimpleQA
0.0386Brier Score
Probe (train on TriviaQA)
Updated 4d ago
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
2026.02 | 0.0386 | - | - | - | - | - | - | |
2026.02 | 0.0419 | - | - | - | - | - | - | |
2026.02 | 0.06 | - | - | - | - | - | - | |
2026.02 | 0.0638 | - | - | - | - | - | - | |
2025.12 | 0.178 | 0.498 | 0.838 | 72.9 | 0.098 | 0.53 | 43.8 | |
2026.02 | 0.1957 | - | - | - | - | - | - | |
2025.12 | 0.214 | 0.456 | 0.783 | 65.8 | 0.2 | 0.614 | 30.8 | |
2026.02 | 0.2676 | - | - | - | - | - | - | |
2025.12 | 0.284 | 0.282 | 0.748 | 54.4 | 0.318 | 0.786 | 29.9 | |
2026.02 | 0.301 | - | - | - | - | - | - | |
2025.12 | 0.31 | 0.358 | 0.739 | 51.8 | 0.377 | 0.878 | 20.6 | |
2026.02 | 0.3109 | - | - | - | - | - | - | |
2026.02 | 0.3133 | - | - | - | - | - | - | |
2025.12 | 0.327 | 0.147 | 0.664 | 55.1 | 0.307 | 0.988 | 49.2 | |
2025.12 | 0.341 | 0.411 | 0.704 | 54 | 0.459 | 1.1 | 5.8 | |
2025.12 | 0.436 | 0.017 | 0.556 | 54.7 | 0.451 | 1.9 | 54.5 | |
2026.02 | 0.4451 | - | - | - | - | - | - | |
2026.02 | 0.4736 | - | - | - | - | - | - | |
2026.02 | 0.4846 | - | - | - | - | - | - | |
2025.12 | 0.525 | 0.211 | 0.734 | 23.6 | 0.665 | 1.51 | 3.1 | |
2026.02 | 0.5465 | - | - | - | - | - | - | |
2026.02 | 0.5871 | - | - | - | - | - | - | |
2026.02 | 0.6072 | - | - | - | - | - | - | |
2026.02 | 0.6151 | - | - | - | - | - | - | |
2026.02 | 0.7048 | - | - | - | - | - | - | |
2025.12 | 0.762 | 0.066 | 0.561 | 14.2 | 0.821 | 2.55 | 6.2 | |
2026.02 | 0.8297 | - | - | - | - | - | - |