| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| ImageNet | Average Prediction Set Size1.9 | 54 | 3d ago | ||
| Distribution Drift simulated (test) | Coverage91.9 | 24 | 3d ago | ||
| Changepoint simulated (test) | OGD | Coverage90 | 24 | 3d ago | |
| F-MNIST | Simple Fano bound | Average Prediction Set Size1.7 | 24 | 3d ago | |
| 89_pegase (test) | PICP (Coverage)100 | 22 | 3d ago | ||
| CIFAR-10 (test) | EC3 | Mean Prediction Set Size1.09 | 21 | 3d ago | |
| iNaturalist | AvgSize3.1 | 20 | 3d ago | ||
| CUB-Birds (test) | RAPS+TTA-Avg | Avg Prediction Set Size1.78 | 18 | 3d ago | |
| iNaturalist (test) | RAPS+TTA-Avg | Avg Prediction Set Size2.61 | 18 | 3d ago | |
| ImageNet ILSVRC2012 (test) | RAPS+TTA-Learned | Avg Prediction Set Size2.312 | 18 | 3d ago | |
| CUB-Birds | APS+TTA-Learned | Average Set Size3.046 | 18 | 3d ago | |
| meps 21 (test) | Local Boosted | Average Length1.795 | 18 | 3d ago | |
| CIFAR 100 | Avg Prediction Set Size8.1 | 17 | 3d ago | ||
| Synthetic Data sample size 5000 (test) | CIR | Marginal Coverage90.7 | 16 | 3d ago | |
| 15 datasets (average) | Conf-OT | Top-1 Accuracy66.7 | 15 | 3d ago | |
| meps19 (test) | CHR | Marginal Coverage90 | 14 | 3d ago | |
| fb2 (test) | CHR | Marginal Coverage90 | 14 | 3d ago | |
| fb1 (test) | CHR | Marginal Coverage90 | 14 | 3d ago | |
| bio (test) | CHR | Marginal Coverage90 | 14 | 3d ago | |
| TinyImageNet-C (test) | ScaleFreeOGD | Coverage89.96 | 14 | 3d ago | |
| blog (test) | CIR | Marginal Coverage0.91 | 14 | 3d ago | |
| Places365 alpha=0.05 (test) | Energy-based SAPS | Set Size18.55 | 12 | 3d ago | |
| Average across 15 datasets (test) | Conf-OT | Top-1 Acc66.7 | 12 | 3d ago | |
| CIFAR-100 (test) | Model-based Fano bound | Mean Prediction Set Size14.61 | 12 | 3d ago | |
| EMNIST ByClass (test) | DPI bound | Mean Prediction Set Size1.98 | 12 | 3d ago |
