Malicious prompt detection on JailBreakV & GPT4V π = 0.005
98.06AUROC
VLMGuard
Updated 18d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2024.10 | 98.06 | 94.79 | |
2024.10 | 96.58 | 93 | |
2024.10 | 94.56 | 80.56 | |
2024.10 | 94.18 | 89.4 | |
2024.10 | 94.03 | 82.7 | |
2024.10 | 92.64 | 78.55 | |
2024.10 | 91.76 | 85.33 | |
2024.10 | 90.27 | 88.53 | |
2024.10 | 90.13 | 83.86 | |
2024.10 | 89.22 | 82.51 | |
2024.10 | 86.16 | 72.52 | |
2024.10 | 85.39 | 69.57 | |
2024.10 | 84.84 | 63.68 | |
2024.10 | 84.53 | 71.14 | |
2024.10 | 83.32 | 76.57 | |
2024.10 | 81.19 | 61.4 | |
2024.10 | 79.02 | 78.32 | |
2024.10 | 77.35 | 77.1 | |
2024.10 | 66.4 | 57.25 | |
2024.10 | 64.83 | 71.4 | |
2024.10 | 64.25 | 62.15 | |
2024.10 | 62.93 | 54.8 | |
2024.10 | 62.71 | 61.34 | |
2024.10 | 59.4 | 59.44 | |
2024.10 | 57.34 | 59.99 | |
2024.10 | 51.65 | 59.62 |