SOTA Membership Inference Attack benchmarks and papers with code

Benchmarks

Dataset Name	SOTA Method	Metric
ELD user-level (test)	RMIA	TPR @ 0% FPR73	78	3d ago
ELD record-level (test)	DTS	TPR @ 0.1% FPR6.66	78	3d ago
ELD	DTS-Online	ROC-AUC0.758	78	3d ago
TUH-EEG	DTS-Online	ROC AUC0.884	78	3d ago
Asclepius (fine-tuned)	HT-MIA	TPR@FPR=0.018.17	58	3d ago
Wikipedia	LiRA	AUC0.9	52	4d ago
AG News (test)	ICP-MIA-SP	AUC0.909	43	4d ago
XSum (test)	SPV-MIA	AUC0.945	43	4d ago
arXivReasoning Sequence-level	BlackSpectrum	ACC68	43	4d ago
GTSRB (test)	DeepLeak	TPR@0.1%FPR43.52	42	3d ago
CIFAR-10 (test)	DeepLeak	TPR@0.1%FPR1,038	42	3d ago
TUH-EEG Record-level (test)	DTS	TPR @ 0.1% FPR2,332	38	3d ago
CIFAR100 (test)		AUC0.99	37	4d ago
HackerNews Pythia	AttenMIA (Perturbed)	ROC AUC0.72	36	3d ago
DM Math Pythia	AttenMIA (Perturbed)	ROC AUC100	36	3d ago
arXiv Pythia	AttenMIA (Perturbed)	ROC AUC94	36	3d ago
PubMed Pythia	AttenMIA (Perturbed)	ROC AUC97	36	3d ago
Pile CC Pythia	AttenMIA (Perturbed)	ROC AUC71	36	3d ago
GitHub Pythia	AttenMIA (Perturbed)	ROC AUC1	36	3d ago
Wikipedia Pythia	AttenMIA (Perturbed)	ROC AUC74	36	3d ago
CNN-DM	SPV-MIA	AUC0.974	36	4d ago
MedInstruct	ICP-MIA-SP	AUC97.7	36	4d ago
HealthcareMagic	ICP-MIA-SP	AUC94.2	36	4d ago
CIFAR-100 balanced (evaluation set)	Int. Outs*	AUROC99.17	36	4d ago
CIFAR100	Curv ZO NLL	AUROC93.49	34	4d ago

Showing 25 of 164 rows