MIMIR
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Membership Inference Attack | MIMIR Github | AUC91.2 | 52 | |
| Membership Inference Attack | MIMIR Average | AUC74.4 | 48 | |
| Membership Inference Attack | MIMIR HackerNews | AUC56.3 | 40 | |
| Membership Inference Attack | MIMIR DM Mathematics | AUC47.8 | 40 | |
| Membership Inference Attack | MIMIR Arxiv | AUC56.2 | 40 | |
| Membership Inference Attack | MIMIR Pile CC | AUC52.3 | 40 | |
| Membership Inference Attack | MIMIR PubMed Central | AUC54.1 | 40 | |
| Membership Inference Attack | MIMIR Wikipedia | AUC57.9 | 40 | |
| Membership Inference Attack | MIMIR HackerNews | TPR@1%FPR2 | 35 | |
| Membership Inference Attack | MIMIR DM Mathematics | TPR @ 1% FPR1.7 | 35 | |
| Membership Inference Attack | MIMIR Arxiv | TPR@1%FPR2.7 | 35 | |
| Membership Inference Attack | MIMIR Github | TPR@1%FPR26 | 35 | |
| Pre-training data detection | MIMIR | AUROC (Wikipedia)0.69 | 30 | |
| Membership Inference Attack | MIMIR | Wiki Success Rate55.5 | 9 | |
| Unauthorized Training Data Detection | MIMIR-Wikipedia Laundered (Syn.) GPT-4o rewrite | AUC0.603 | 5 | |
| Unauthorized Training Data Detection | MIMIR Wikipedia (Original) | AUC1 | 5 |
Showing 16 of 16 rows