| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| Flickr | AutoMIA | TPR @ 5% FPR27.7 | 142 | 2mo ago | |
| CIFAR-10 | DATM | AUC98 | 120 | 1mo ago | |
| NYU v2 | Ours | AUC98.58 | 90 | 13d ago | |
| WikiMIA length 64 | ReproMIA | AUC0.9556 | 84 | 2mo ago | |
| ELD user-level (test) | RMIA | TPR @ 0% FPR73 | 78 | 3mo ago | |
| ELD record-level (test) | DTS | TPR @ 0.1% FPR6.66 | 78 | 3mo ago | |
| ELD | DTS-Online | ROC-AUC0.758 | 78 | 3mo ago | |
| TUH-EEG | DTS-Online | ROC AUC0.884 | 78 | 3mo ago | |
| Wikipedia | LiRA | AUC0.9 | 75 | 1mo ago | |
| WikiMIA K = 16 | JECS | Attack Power0.643 | 72 | 12d ago | |
| Flickr | AutoMIA | Accuracy68.7 | 71 | 2mo ago | |
| Pile CC | ReproMIA | TPR @ 1%1.7 | 61 | 2mo ago | |
| TinyImageNet 200 | DATM | Balanced Accuracy79 | 60 | 3mo ago | |
| Asclepius (fine-tuned) | HT-MIA | TPR@FPR=0.018.17 | 58 | 3mo ago | |
| WikiMIA length 128 | ReproMIA | AUC98.84 | 56 | 2mo ago | |
| ArXiv | SAMA | AUC85 | 55 | 1mo ago | |
| DALL·E (test) | AutoMIA | TPR @ 5% FPR29.4 | 54 | 2mo ago | |
| WikiMIA length 32 | ReproMIA | TPR @ 5% FPR0.5964 | 54 | 2mo ago | |
| MIMIR Github | Zlib | AUC91.2 | 52 | 2mo ago | |
| WikiMIA length 128 (test) | ReproMIA | TPR @ 5% FPR96.72 | 49 | 2mo ago | |
| WikiMIA length 64 (test) | ReproMIA | TPR@5%FPR73.77 | 49 | 2mo ago | |
| CIFAR-10 | CoLA | AUC0.9686 | 48 | 1mo ago | |
| MIMIR Average | Loss | AUC74.4 | 48 | 2mo ago | |
| CIFAR-10 (test) | DeepLeak | TPR@0.1%FPR1,038 | 46 | 7d ago | |
| CIFAR-100 | ReproMIA | TPR @ 1% FPR70.37 | 46 | 4d ago |
