| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| VLCB Pooled Aggregate (test) | InternalInspector | ECE4.29 | 48 | 2mo ago | |
| SCITLDR (dev) | HRE | smECE0.08 | 21 | 1mo ago | |
| APIGen (test) | HRE | smECE0.02 | 21 | 1mo ago | |
| TRICKME | VANILLA-VERB | Accuracy53.88 | 20 | 4mo ago | |
| GRACE | VANILLA-VERB | Accuracy48.27 | 20 | 4mo ago | |
| GUESS | VANILLA-VERB | Accuracy0.1858 | 20 | 4mo ago | |
| 20Q | VANILLA-VERB | Accuracy33.87 | 20 | 4mo ago | |
| Open-Set | GPT-4.1 + Verbalized Conf. | Accuracy67.2 | 16 | 3mo ago | |
| Closed-Set tasks | GPT-4.1 + Verbalized Conf. | Accuracy (ACC)72 | 16 | 3mo ago | |
| Global-MMLU (test) | Last Answer | AUROC0.78 | 14 | 1mo ago | |
| MKQA (test) | Last Answer | AUROC0.82 | 14 | 1mo ago | |
| Polyp OOD | AURC14.1 | 13 | 4mo ago | ||
| Polyp ID | AURC6.8 | 13 | 4mo ago | ||
| Optic Cup OOD | AURC0.605 | 13 | 4mo ago | ||
| Optic Cup ID | AURC0.117 | 13 | 4mo ago | ||
| MSWML OOD | TLA | AURC61.2 | 13 | 4mo ago | |
| MSWML ID | AURC41.8 | 13 | 4mo ago | ||
| Skin Cancer | AURC8.5 | 13 | 4mo ago | ||
| Breast Cancer | AURC0.343 | 13 | 4mo ago | ||
| Brain Tumor | AURC0.089 | 13 | 4mo ago | ||
| VECBench OOD VER | EmoCaliber | ECE0.1217 | 13 | 4mo ago | |
| VECBench ID VSA | Qwen3-VL | ECE0.37 | 13 | 4mo ago | |
| VECBench ID VER | EmoCaliber | ECE13.63 | 13 | 4mo ago | |
| DocILE (full) | EXTRACTCONF | AUC0.928 | 11 | 1mo ago | |
| TL;DR | Verbalized Confidence | Rank Correlation (RK)0.421 | 11 | 2mo ago |
