Share your thoughts, 1 month free Claude Pro on usSee more

Conformal Prediction

Benchmarks

Dataset Name	SOTA Method	Metric
5-class synthetic data Example 1 Hard Bin r* ≤ 0.5	ACP-ACC	Coverage93.4	97	1mo ago
5-class synthetic data Example 1 Marginal	ACP-AEC	Coverage92.3	97	1mo ago
5-class Synthetic Data Example 2 covariate shift a=0.5 Marginal	ACP-ACC	Coverage92	75	1mo ago
ImageNet		Average Prediction Set Size1.52	63	1mo ago
5-class synthetic data (Example 1) Easy Bin (r* > 0.5) 1.0 (test)	AdaTS	Coverage99.7	52	1mo ago
CIFAR-100 (test)	TSCP	Mean Prediction Set Size1.6436	51	1mo ago
Example 2 5-class data (a=0.5, Easy Bin, r* > 0.5) synthetic (test)		Coverage96.6	45	1mo ago
Example 2 5-class data (a=0.5, Hard Bin, r* <= 0.5) synthetic (test)	ACP-MC-Oracle	Coverage90.4	45	1mo ago
5-class synthetic data Example 1, Easy Bin r* > 0.5	AdaTS	Coverage99.7	45	1mo ago
15 datasets (average)		Coverage95.7	39	2mo ago
VentricularVolume (OUT)	RoBAS-Full	Interval Width3.572	35	18d ago
CIFAR 100		Avg Prediction Set Size1.15	32	2mo ago
Camelyon17 r* > 0.67 (test)		Coverage92.4	30	1mo ago
Camelyon17 (0.33 < r* ≤ 0.67) (test)	ACP-ACC	Coverage88.2	30	1mo ago
Camelyon (r* ≤ 0.33) 17 (test)		Coverage91.1	30	1mo ago
Camelyon17 Marginal (test)	ACP-ACC	Coverage91.2	30	1mo ago
CIFAR-10 C	ACP-ACC	Marginal Coverage92.9	30	1mo ago
5-class synthetic data Easy Bin, r* > 0.5	AdaTS	Coverage99.7	30	1mo ago
5-class synthetic data Hard Bin, r* <= 0.5	ACP-ACC	Coverage92.8	30	1mo ago
5-class synthetic data Marginal	ACP-AEC	Coverage92.3	30	1mo ago
synthetic data 5-class Example 2 covariate shift a=0.5 Easy Bin (r* > 0.5)		Coverage96.6	30	1mo ago
5-class synthetic data Example 2 covariate shift a=0.5 Hard Bin (r* <= 0.5)	ACP-ACC	Coverage85.6	30	1mo ago
MNIST (test)		Coverage100	30	1mo ago
FashionMNIST (test)		Efficiency Rate (γn,m)3.2814	27	1mo ago
2D Navier-Stokes (test)	UQNO	Coverage98.09	25	1mo ago

Showing 25 of 225 rows

...