Confidence Calibration on LogiQA (out-of-distribution)
8ECE
ADVICE w/ ConfTuner
Updated 1mo ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2025.10 | 8 | 6.2 | 24.6 | 69 | |
2025.10 | 11.9 | 10.9 | 25.8 | 57.8 | |
2025.10 | 18.4 | 17.9 | 23.8 | 71.4 | |
2025.10 | 23 | 21.2 | 30.1 | 57.9 | |
2025.10 | 24 | 23.1 | 28.1 | 68 | |
2025.10 | 24.8 | 24.8 | 22.1 | 63.1 | |
2025.10 | 26 | 23.8 | 31.1 | 58.6 | |
2025.10 | 28.6 | 28.2 | 32.5 | 54.4 | |
2025.10 | 35.6 | 31.6 | 38.2 | 59.3 | |
2025.10 | 39 | 38.7 | 40.3 | 50.3 | |
2025.10 | 39 | 38.8 | 41.8 | 44.8 | |
2025.10 | 39.1 | 39 | 40.4 | 50.9 | |
2025.10 | 45.3 | 45.1 | 46.2 | 45.6 | |
2025.10 | 45.7 | 45.4 | 43.2 | 59 | |
2025.10 | 48.1 | 47.4 | 48 | 50.4 | |
2025.10 | 49.2 | 48 | 49.2 | 51.4 | |
2025.10 | 51.8 | 50.9 | 51.3 | 52.1 | |
2025.10 | 53.8 | 53.3 | 52.9 | 50.5 |