Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

TextShield-R1: Reinforced Reasoning for Tampered Text Detection

About

The growing prevalence of tampered images poses serious security threats, highlighting the urgent need for reliable detection methods. Multimodal large language models (MLLMs) demonstrate strong potential in analyzing tampered images and generating interpretations. However, they still struggle with identifying micro-level artifacts, exhibit low accuracy in localizing tampered text regions, and heavily rely on expensive annotations for forgery interpretation. To this end, we introduce TextShield-R1, the first reinforcement learning based MLLM solution for tampered text detection and reasoning. Specifically, our approach introduces Forensic Continual Pre-training, an easy-to-hard curriculum that well prepares the MLLM for tampered text detection by harnessing the large-scale cheap data from natural image forensic and OCR tasks. During fine-tuning, we perform Group Relative Policy Optimization with novel reward functions to reduce annotation dependency and improve reasoning capabilities. At inference time, we enhance localization accuracy via OCR Rectification, a method that leverages the MLLM's strong text recognition abilities to refine its predictions. Furthermore, to support rigorous evaluation, we introduce the Text Forensics Reasoning (TFR) benchmark, comprising over 45k real and tampered images across 16 languages, 10 tampering techniques, and diverse domains. Rich reasoning-style annotations are included, allowing for comprehensive assessment. Our TFR benchmark simultaneously addresses seven major limitations of existing benchmarks and enables robust evaluation under cross-style, cross-method, and cross-language conditions. Extensive experiments demonstrate that TextShield-R1 significantly advances the state of the art in interpretable tampered text detection.

Chenfan Qu, Yiwu Zhong, Jian Liu, Xuekang Zhu, Bohan Yu, Lianwen Jin• 2026

Related benchmarks

TaskDatasetResultRank
Tampered Text ClassificationTFR (test)
Accuracy88.1
32
Tampered Text LocalizationTFR (test)
IoU5.78e+3
32
Forgery ReasoningTFR (test)
Avg Reasoning Score (Cosine/Rouge-L/BLEU)58.8
16
Forgery ReasoningTFR CIS Cross-Image-domain
Reasoning Score56.5
16
Forgery ReasoningTFR CTM Cross-Method
Reasoning Score51.2
16
Forgery ReasoningTFR Cross-Language
Avg Reasoning Score46.2
16
Tampered Text ClassificationTFR CTM Cross-Method
Accuracy88.8
16
Tampered Text ClassificationTFR CL (Cross-Language)
Accuracy85.5
16
Tampered Text LocalizationTFR CTM Cross-Method
IoU0.683
16
Tampered Text LocalizationTFR CL (Cross-Language)
IoU40.6
16
Showing 10 of 14 rows

Other info

Follow for update