Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

TransForensics: Image Forgery Localization with Dense Self-Attention

About

Nowadays advanced image editing tools and technical skills produce tampered images more realistically, which can easily evade image forensic systems and make authenticity verification of images more difficult. To tackle this challenging problem, we introduce TransForensics, a novel image forgery localization method inspired by Transformers. The two major components in our framework are dense self-attention encoders and dense correction modules. The former is to model global context and all pairwise interactions between local patches at different scales, while the latter is used for improving the transparency of the hidden layers and correcting the outputs from different branches. Compared to previous traditional and deep learning methods, TransForensics not only can capture discriminative representations and obtain high-quality mask predictions but is also not limited by tampering types and patch sequence orders. By conducting experiments on main benchmarks, we show that TransForensics outperforms the stateof-the-art methods by a large margin.

Jing Hao, Zhixin Zhang, Shicai Yang, Di Xie, Shiliang Pu• 2021

Related benchmarks

TaskDatasetResultRank
Forgery DetectionIMD20 79 (test)
AUC0.848
10
Forgery DetectionCAISA 78 (test)
AUC0.837
10
Forgery DetectionCASIA 1.0
F1 Score0.627
8
Showing 3 of 3 rows

Other info

Follow for update