Share your thoughts, 1 month free Claude Pro on usSee more

Safety Evaluation on NSFW images (test)

12.8ASR

gemma-3-27b-it

Updated 2mo ago

Evaluation Results

Method	Links
gemma-3-27b-it 2025.09		12.8
gemma-3-12b-it 2025.09		19.4
Average 2025.09		57.5
Qwen2.5-VL-32B-Instruct 2025.09		97.8
Qwen2.5-VL-7B-Instruct 2025.09		99.8
gemma-3-12b-it 2025.09		100
gemma-3-27b-it 2025.09		100
Qwen2.5-VL-7B-Instruct 2025.09		100
Qwen2.5-VL-32B-Instruct 2025.09		100
Average 2025.09		100