| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| ImageNet | Average Prediction Set Size1.52 | 63 | 1mo ago | ||
| CIFAR 100 | Avg Prediction Set Size1.15 | 26 | 1mo ago | ||
| Distribution Drift simulated (test) | Coverage91.9 | 24 | 1mo ago | ||
| Changepoint simulated (test) | OGD | Coverage90 | 24 | 1mo ago | |
| F-MNIST | Simple Fano bound | Average Prediction Set Size1.7 | 24 | 1mo ago | |
| 89_pegase (test) | PICP (Coverage)100 | 22 | 1mo ago | ||
| CIFAR-10 (test) | EC3 | Mean Prediction Set Size1.09 | 21 | 1mo ago | |
| CIFAR 10 | semicp | Avg Prediction Set Size0.9 | 21 | 1mo ago | |
| iNaturalist | AvgSize3.1 | 20 | 1mo ago | ||
| CUB-Birds (test) | RAPS+TTA-Avg | Avg Prediction Set Size1.78 | 18 | 1mo ago | |
| iNaturalist (test) | RAPS+TTA-Avg | Avg Prediction Set Size2.61 | 18 | 1mo ago | |
| ImageNet ILSVRC2012 (test) | RAPS+TTA-Learned | Avg Prediction Set Size2.312 | 18 | 1mo ago | |
| CUB-Birds | APS+TTA-Learned | Average Set Size3.046 | 18 | 1mo ago | |
| meps 21 (test) | Local Boosted | Average Length1.795 | 18 | 1mo ago | |
| Skin Lesion | COMPASS-J | Interval Size1,318 | 16 | 1mo ago | |
| H&E | COMPASS-L | Interval Size1,759 | 16 | 1mo ago | |
| Synthetic Data sample size 5000 (test) | CIR | Marginal Coverage90.7 | 16 | 1mo ago | |
| 15 datasets (average) | Conf-OT | Top-1 Accuracy66.7 | 15 | 1mo ago | |
| meps19 (test) | CHR | Marginal Coverage90 | 14 | 1mo ago | |
| fb2 (test) | CHR | Marginal Coverage90 | 14 | 1mo ago | |
| fb1 (test) | CHR | Marginal Coverage90 | 14 | 1mo ago | |
| bio (test) | CHR | Marginal Coverage90 | 14 | 1mo ago | |
| TinyImageNet-C (test) | ScaleFreeOGD | Coverage89.96 | 14 | 1mo ago | |
| blog (test) | CIR | Marginal Coverage0.91 | 14 | 1mo ago | |
| Kidney tissue microscopy | TrustFed | Coverage92 | 12 | 25d ago |