Share your thoughts, 1 month free Claude Pro on usSee more

Safety Evaluation on VLSafe Orig.

0.23Unsafe Rate

VLGuard PH

Updated 1mo ago

Evaluation Results

Method	Links
VLGuard PH 2024.10		0.23
VLGuard PH 2024.10		0.56
LLaVA-v1.5-13B 2024.10		0.68
CMRM_sample 2024.10		0.79
VLGuard Mixed 2024.10		1.13
LLaVA-v1.5-13B 2024.10		1.25
CMRM_sample 2024.10		1.46
LLaVA-v1.5-7B 2024.10		1.91
CMRM_dataset 2024.10		1.91
VLGuard Mixed 2024.10		2.03
CMRM_sample 2024.10		3.15
ShareGPT4V 2024.10		4.13
CMRM_dataset 2024.10		4.95
ShareGPT4V 2024.10		5.32
CMRM_dataset 2024.10		5.41
LLaVA-v1.5-7B 2024.10		5.52
LLaVA-v1.5-13B 2024.10		31.8
ShareGPT4V 2024.10		57.09
LLaVA-v1.5-7B 2024.10		61.53