Membership Inference

Benchmarks

Dataset Name	SOTA Method	Metric
VL-MIA DALL·E	DistractMIA	AUROC89.1	120	20d ago
WikiMIA 32 tokens 1.0	AttenMIA (Transitional)	ROC AUC99.7	66	3mo ago
CLIP image-text (train)	UMID	Precision91.68	36	2mo ago
GitHub Pythia (train)	AttenMIA (Perturbed)	TPR@1%FPR95.6	36	3mo ago
Wikipedia Pythia (train)	AttenMIA (Perturbed)	TPR@1%FPR22.7	36	3mo ago
LIMR	SLaRA	AUC0.81	24	5d ago
Eurus	SC + SLaRA	AUC0.79	24	5d ago
Pile CC Pythia (train)	AttenMIA (Perturbed)	TPR@1%FPR7.4	24	3mo ago
TinyImageNet	CoFedMID	Loss0.51	23	3mo ago
Real Authors (test)	G-Drift	AUC99.5	21	2mo ago
World Facts (test)	G-Drift	AUC99.83	21	2mo ago
WikiMIA (test)	G-Drift	AUC0.9998	21	2mo ago
Pokemon	CLiDth	ASR97.96	21	5d ago
MS-COCO	CLiDvec	ASR99.74	21	5d ago
CIFAR-10	LeakBoost	AUC0.885	20	3mo ago
Video modality	FiMMIA	AUC-ROC100	16	3mo ago
PMC	DistractMIA	AUC99.9	15	20d ago
DM Math Pythia (train)	AttenMIA (Perturbed)	TPR@1%FPR99.3	15	3mo ago
Flickr	CLiDvec	ASR91.78	15	3mo ago
12 datasets mean over 32 replicates	BaVarIA-n	Offline AUC0.786	12	2mo ago
arXiv Pythia (train)	AttenMIA (Perturbed)	TPR@1%FPR55.4	12	3mo ago
PubMed Pythia (train)	AttenMIA (Perturbed)	TPR@1%FPR67.3	12	3mo ago
MIA-Bench 5% Forget Set		Average Performance69.6	12	3mo ago
WikiMIA 128 tokens 1.0	AttenMIA (Transitional)	ROC AUC94.8	11	3mo ago
WikiMIA 64 tokens 1.0	AttenMIA (Transitional)	ROC AUC97.9	11	3mo ago

Showing 25 of 78 rows