VL-MIA
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Image Membership Inference Attack | VL-MIA Flickr (test) | AUC0.999 | 149 | |
| Membership Inference | VL-MIA DALL·E | AUROC89.1 | 120 | |
| Membership Inference Attack | VL-MIA Flickr 2k | AUC0.814 | 45 | |
| Membership Inference Attack | VL-MIA Flickr v1 (test) | AUC0.812 | 45 | |
| Membership Inference Attack (TEXTLEN=32) | VL-MIA TEXT | Accuracy78.2 | 33 | |
| Membership Inference Attack | VL-MIA Text LLaMA Adapter TEXTLEN=64 | AUC77.8 | 21 | |
| Membership Inference Attack | VL-MIA Text LLaMA Adapter TEXTLEN=32 | AUC82.8 | 21 | |
| Membership Inference Attack | VL-MIA Text MiniGPT-4 TEXTLEN=64 | AUC89.1 | 21 | |
| Membership Inference Attack | VL-MIA Text MiniGPT-4 TEXTLEN=32 | AUC82.4 | 21 | |
| Membership Inference Attack | VL-MIA Text LLaVA TEXTLEN=64 | AUC0.994 | 21 | |
| Membership Inference Attack | VL-MIA Text LLaVA TEXTLEN=32 | AUC81 | 21 | |
| Membership Inference Attack (TEXTLEN=64) | VL-MIA TEXT | Accuracy96.3 | 18 | |
| Membership Inference Attack | VL-MIA Flickr | AUC0.793 | 15 | |
| Membership Inference Attack | VL-MIA Flickr (test) | AUC0.736 | 15 | |
| Image Membership Inference Attack | VL-MIA DALL-E (test) | AUC81.5 | 14 | |
| Membership Inference Attack | VL-MIA DALL-E 1.0 (test) | TPR@5%FPR (Aug_KL)8.1 | 11 | |
| Membership Inference Attack | VL-MIA Flickr 1.0 (test) | TPR@5%FPR (Aug_KL)8 | 11 |
Showing 17 of 17 rows