Membership Inference Attack on VL-MIA DALL-E 1.0 (test)
8.1TPR@5%FPR (Aug_KL)
LLaVA
Updated 1mo ago
Evaluation Results
| Method | Links | |||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2024.11 | 8.1 | 0.027 | 0.081 | 0.081 | 0.064 | 10.8 | 0.02 | 0.034 | 0.024 | 8.8 | 8.8 | 9.8 | 10.1 | 10.1 | 10.1 | 9.1 | 9.1 | 10.1 | 11.2 | 11.2 | 12.2 | |
2024.11 | 6.4 | 0.014 | 0.054 | 0.054 | 0.064 | 3.7 | 0.024 | 0.02 | 0.037 | 6.1 | 6.1 | 6.4 | 3.7 | 3.7 | 7.8 | 3 | 3 | 5.4 | 2.7 | 2.7 | 3.7 | |
2024.11 | 5.1 | 0.057 | 0.081 | 0.041 | 0.03 | 6.4 | 0.041 | 0.057 | 0.054 | 8.5 | 9.5 | 8.1 | 4.4 | 6.4 | 8.1 | 5.4 | 6.8 | 9.8 | 6.8 | 9.1 | 9.8 | |
2024.11 | 3.7 | 0.081 | 0.051 | 0.068 | 0.071 | 8.5 | 0.088 | 0.095 | 0.088 | 4.7 | 6.4 | 9.5 | 6.4 | 6.1 | 8.1 | 5.1 | 5.1 | 10.1 | 5.1 | 6.8 | 8.1 | |
2024.11 | 3.7 | 0.034 | 0.051 | 0.057 | 0.054 | 3 | 0.027 | 0.061 | 0.03 | 6.1 | 6.1 | 2 | 4.4 | 3.7 | 1.7 | 2.7 | 1.7 | 1.4 | 1.4 | 1.7 | 1.4 | |
2024.11 | 3.4 | 0.081 | 0.051 | 0.03 | 0.034 | 7.4 | 0.081 | 0.074 | 0.068 | 5.1 | 6.1 | 4.7 | 5.4 | 4.1 | 5.1 | 5.4 | 3.7 | 5.1 | 5.1 | 5.4 | 6.4 | |
2024.11 | 3 | 0.034 | 0.03 | 0.02 | 0.02 | 3.7 | 0.03 | 0.027 | 0.03 | 2 | 1.7 | 1.7 | 2.7 | 1.4 | 2.7 | 3 | 2 | 2.7 | 4.4 | 2 | 3.4 | |
2024.11 | 3 | 0.03 | 0.037 | 0.02 | 0.02 | 4.7 | 0.037 | 0.041 | 0.034 | 11.2 | 16.2 | 3 | 8.8 | 7.1 | 2.7 | 5.1 | 3.4 | 3 | 4.7 | 3.4 | 2.4 | |
2024.11 | 2.7 | 0.051 | 0.037 | 0.02 | 0.017 | 7.1 | 0.064 | 0.041 | 0.061 | 11.2 | 4.4 | 3.4 | 8.1 | 5.1 | 3.4 | 4.7 | 5.7 | 6.1 | 4.7 | 3.4 | 4.1 | |
2024.11 | 2 | - | - | - | - | 3.7 | - | - | - | 8.1 | 15.2 | 0.3 | 9.1 | 22 | 0.3 | 11.8 | 17.2 | 1.7 | 12.8 | 14.2 | 2.4 | |
2024.11 | 1.4 | - | - | - | - | 5.1 | - | - | - | 6.1 | 6.8 | 8.8 | 5.4 | 7.4 | 6.1 | 5.1 | 7.1 | 8.8 | 6.8 | 7.4 | 9.5 |