Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Safe Alone, Unsafe Together: Safeguarding Against Implicit Toxicity When Benign Images Combine

About

Multi-image content has become an increasingly prevalent form of visual communication in social media, giving rise to a new safety issue, multi-image implicit toxicity (MIIT), where each image appears benign in isolation, but harmful semantics emerge when the images are interpreted jointly. MIIT is particularly challenging for existing commercial moderation APIs and models due to the lack of explicit risky cues in each image. This paper aims to study how to identify MIIT. We first provide a formal definition of MIIT and analyze three key challenges for its detection. To alleviate the scarcity of data in this area, we construct MIIT-dataset, an image-only multi-image safety dataset covering seven representative risk categories through an automatic generation pipeline. Finally, we train MiShield with progressively distilled reasoning supervision, enabling it to produce safety judgments accompanied by explicit analyses of the correlated entities that result in the hazards. Experiments show that MiShield-8B models outperform representative moderation services and even larger-scale models, revealing its effectiveness and practical value for this widely used visual format. Warning: This paper contains potentially sensitive content.

Jiaxian Lv, Shiyao Cui, Yingkang Wang, Guoxin Wu, Qingling Zhang, Minlie Huang• 2026

Related benchmarks

TaskDatasetResultRank
Safety EvaluationUnsafeBench--
39
Unsafe content detectionLlavaGuard
Accuracy83.27
21
Multi-image safety detectionMIIT-dataset (test)
Unsafe Precision90.41
15
Multi-image Content Safety ClassificationMIIT-dataset (OOD)
F1 (Unsafe)87.4
8
Showing 4 of 4 rows

Other info

Follow for update