Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Deep Residual Injection for Full-Spectrum Forensic Signal Perception in Multimodal Large Language Models

About

Multimodal large language models (MLLMs) have been increasingly adopted in forensics for their robust semantic understanding. As AI-generated images become realistic, semantic-level inconsistencies alone are often insufficient for reliable detection. This motivates a critical question: whether MLLMs can achieve full-spectrum forensic signal perception, i.e., capturing low-level generator artifacts without sacrificing pre-trained semantic knowledge. We further perform a layer-wise analysis of forensic signal perception in MLLMs, showing that semantic information is primarily formed in the early-to-middle layers, whereas direct fine-tuning for artifact learning disrupts these semantic representations. Based on this insight, we propose Deep Visual Residual MLLM (Deep-VRM) to preserve early semantic processing while injecting artifact-specific visual signals as a residual path into an intermediate layer, where they are fused with semantic token representations and propagated through subsequent trainable layers. This enables later layers to jointly model semantic reasoning and signal-level forensic cues, and surprisingly, the model learns to adaptively leverage different levels of forensic signals depending on the input, achieving robust and generalizable detection performance. Extensive experiments show that our method achieves state-of-the-art across most benchmarks. The code and data are available at https://github.com/KQL11/Deep-VRM.

Kaiqing Lin, Zhiyuan Yan, Ruoxin Chen, Ke-Yue Zhang, Yue Zhou, Caiyong Piao, Bin Li, Taiping Yao, Bo Wang, Youchang Xiao, Shouhong Ding• 2026

Related benchmarks

TaskDatasetResultRank
AI-generated image detectionGenImage
Midjourney Detection Rate96.16
173
AI-generated image detectionAIGI-Now
FLUX-dev Pixel Score0.991
49
AI-generated image detectionWildRF
FB Score85.94
42
Generated Image DetectionEvalGEN
Flux Score100
18
AI-generated image detectionAIGIBench
SocRF Score83.68
18
Fake Image DetectionGenImage++ (test)
Flux Score99.85
11
AI-generated image detectionAIGI-Holmes
Janus77.4
9
Fake Image DetectionCommunity Forensics evaluation
DALL-E 3 Accuracy99.8
5
Showing 8 of 8 rows

Other info

Follow for update