Our new X account is live! Follow @wizwand_team for updates

Safety Evaluation on VLSafe Orig.

0.23Unsafe Rate

VLGuard PH

Updated 4d ago

Evaluation Results

Method	Links
VLGuard PH 2024.10		0.23
VLGuard PH 2024.10		0.56
LLaVA-v1.5-13B 2024.10		0.68
CMRM_sample 2024.10		0.79
VLGuard Mixed 2024.10		1.13
LLaVA-v1.5-13B 2024.10		1.25
CMRM_sample 2024.10		1.46
LLaVA-v1.5-7B 2024.10		1.91
CMRM_dataset 2024.10		1.91
VLGuard Mixed 2024.10		2.03
CMRM_sample 2024.10		3.15
ShareGPT4V 2024.10		4.13
CMRM_dataset 2024.10		4.95
ShareGPT4V 2024.10		5.32
CMRM_dataset 2024.10		5.41
LLaVA-v1.5-7B 2024.10		5.52
LLaVA-v1.5-13B 2024.10		31.8
ShareGPT4V 2024.10		57.09
LLaVA-v1.5-7B 2024.10		61.53