| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| VLCB Pooled Aggregate (test) | InternalInspector | ECE4.29 | 48 | 21d ago | |
| TRICKME | VANILLA-VERB | Accuracy53.88 | 20 | 3mo ago | |
| GRACE | VANILLA-VERB | Accuracy48.27 | 20 | 3mo ago | |
| GUESS | VANILLA-VERB | Accuracy0.1858 | 20 | 3mo ago | |
| 20Q | VANILLA-VERB | Accuracy33.87 | 20 | 3mo ago | |
| Open-Set | GPT-4.1 + Verbalized Conf. | Accuracy67.2 | 16 | 2mo ago | |
| Closed-Set tasks | GPT-4.1 + Verbalized Conf. | Accuracy (ACC)72 | 16 | 2mo ago | |
| Global-MMLU (test) | Last Answer | AUROC0.78 | 14 | 2d ago | |
| MKQA (test) | Last Answer | AUROC0.82 | 14 | 2d ago | |
| Polyp OOD | AURC14.1 | 13 | 2mo ago | ||
| Polyp ID | AURC6.8 | 13 | 2mo ago | ||
| Optic Cup OOD | AURC0.605 | 13 | 2mo ago | ||
| Optic Cup ID | AURC0.117 | 13 | 2mo ago | ||
| MSWML OOD | TLA | AURC61.2 | 13 | 2mo ago | |
| MSWML ID | AURC41.8 | 13 | 2mo ago | ||
| Skin Cancer | AURC8.5 | 13 | 2mo ago | ||
| Breast Cancer | AURC0.343 | 13 | 2mo ago | ||
| Brain Tumor | AURC0.089 | 13 | 2mo ago | ||
| VECBench OOD VER | EmoCaliber | ECE0.1217 | 13 | 3mo ago | |
| VECBench ID VSA | Qwen3-VL | ECE0.37 | 13 | 3mo ago | |
| VECBench ID VER | EmoCaliber | ECE13.63 | 13 | 3mo ago | |
| TL;DR | Verbalized Confidence | Rank Correlation (RK)0.421 | 11 | 16d ago | |
| Chatbot Arena | Verbalized Confidence | Rank Correlation (RK)0.3524 | 11 | 16d ago | |
| HH-RLHF | Rank Correlation (RK)0.4718 | 11 | 16d ago | ||
| AlpacaEval | Verbalized Confidence | Rank Correlation (RK)0.4395 | 11 | 16d ago |
