Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

ForensicsTok: Forensics-Guided Tokenized Modeling for Image Tampering Localization

About

Multi-modal Large Language Models (MLLMs) offer powerful reasoning for forensic tasks, yet existing approaches utilizing exogenous segmentation decoders often suffer from suboptimal localization. The reliance on stitched pipelines introduces information bottlenecks during backpropagation, which dilutes spatial signals and is limited by semantic priors of the segmentor. To address these limitations, we propose ForensicsTok, which reformulates image manipulation localization as an autoregressive sequence generation task. ForensicsTok directly generates spatially grounded token sequences, enabling precise mask prediction without intermediary supervision. Specifically, we introduce a Token Splatting Decoder (TSD) to map tokens to binary masks via codebook-aware code smoothing, which mitigates sharp gradients from deterministic detokenizers. Furthermore, to capture diverse tampering clues, we propose a Hierarchical Expert Fusion (HEF) module that injects multi-scale features from a forensic expert model. This unified architecture effectively compensates for the lack of forensic priors in standard MLLMs. Extensive experiments on six benchmarks show that ForensicsTok substantially improves over existing MLLM-based baselines and slightly improves over strong forensic expert baselines, while exhibiting stronger robustness to perturbations.

Lei Xu, Haowei Wang, Shen Chen, Taiping Yao, Bin Li, Changsheng Chen• 2026

Related benchmarks

TaskDatasetResultRank
Tamper LocalizationColumbia
IoU89
36
Tamper LocalizationNIST
IoU44
30
Image Manipulation LocalizationImage Manipulation Localization Robustness
F1 Score79
21
Pixel-level Forgery LocalizationCoverage
F1 Score77
19
Tamper LocalizationCASIA v1
IoU78
15
Tampering LocalizationGLIDE
IoU66
8
Tampering LocalizationIMD
IoU65
8
Image Tampering ClassificationSID-Set (test)
Real Accuracy99
6
Showing 8 of 8 rows

Other info

Follow for update