Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

TransForensics: Image Forgery Localization with Dense Self-Attention

About

Nowadays advanced image editing tools and technical skills produce tampered images more realistically, which can easily evade image forensic systems and make authenticity verification of images more difficult. To tackle this challenging problem, we introduce TransForensics, a novel image forgery localization method inspired by Transformers. The two major components in our framework are dense self-attention encoders and dense correction modules. The former is to model global context and all pairwise interactions between local patches at different scales, while the latter is used for improving the transparency of the hidden layers and correcting the outputs from different branches. Compared to previous traditional and deep learning methods, TransForensics not only can capture discriminative representations and obtain high-quality mask predictions but is also not limited by tampering types and patch sequence orders. By conducting experiments on main benchmarks, we show that TransForensics outperforms the stateof-the-art methods by a large margin.

Jing Hao, Zhixin Zhang, Shicai Yang, Di Xie, Shiliang Pu• 2021

Related benchmarks

TaskDatasetResultRank
Image Forgery LocalizationColumbia Unseen Domain
mIoU25
30
Image Forgery LocalizationCASIA v1
Pixel-level AUC44.2
20
Image Forgery LocalizationColumbia
DSC35.9
15
Image Forgery LocalizationMSID Unseen Domain
mIoU46.5
15
Image Forgery LocalizationDIS25k
DSC32.3
15
Image Forgery LocalizationMSID
DSC60
15
Image Forgery Localizationin the wild
DSC31.9
15
Image Forgery LocalizationIMD 2020
DSC27.2
15
Image Forgery LocalizationCASIA Seen Domain v2
mIoU32
15
Image Forgery LocalizationDIS25k Unseen Domain
mIoU24.1
15
Showing 10 of 18 rows

Other info

Follow for update