Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

CrossGuard: Safeguarding MLLMs against Joint-Modal Implicit Malicious Attacks

About

Multimodal Large Language Models (MLLMs) achieve strong reasoning and perception capabilities but are increasingly vulnerable to jailbreak attacks. While existing work focuses on explicit attacks, where malicious content resides in a single modality, recent studies reveal implicit attacks, in which benign text and image inputs jointly express unsafe intent. Such joint-modal threats are difficult to detect and remain underexplored, largely due to the scarcity of high-quality implicit data. We propose ImpForge, an automated red-teaming pipeline that leverages reinforcement learning with tailored reward modules to generate diverse implicit samples across 14 domains. Building on this dataset, we further develop CrossGuard, an intent-aware safeguard providing robust and comprehensive defense against both explicit and implicit threats. Extensive experiments across safe and unsafe benchmarks, implicit and explicit attacks, and multiple out-of-domain settings demonstrate that CrossGuard significantly outperforms existing defenses, including advanced MLLMs and guardrails, achieving stronger security while maintaining high utility. This offers a balanced and practical solution for enhancing MLLM robustness against real-world multimodal threats. Our code is released: https://github.com/ZhangXu0963/CrossGuard.

Xu Zhang, Hao Li, Zhichao Lu• 2025

Related benchmarks

TaskDatasetResultRank
Safety EvaluationMM-SafetyBench
Average ASR0.38
98
Safety EvaluationJailBreakV
ASR0.72
27
Safety EvaluationVLGuard
ASR7.24
27
Multimodal Safety EvaluationSIUO
ASR5.39
9
Multimodal Safety EvaluationFigStep
ASR (%)0.21
9
Showing 5 of 5 rows

Other info

Follow for update