Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

SAFIRE: Segment Any Forged Image Region

About

Most techniques approach the problem of image forgery localization as a binary segmentation task, training neural networks to label original areas as 0 and forged areas as 1. In contrast, we tackle this issue from a more fundamental perspective by partitioning images according to their originating sources. To this end, we propose Segment Any Forged Image Region (SAFIRE), which solves forgery localization using point prompting. Each point on an image is used to segment the source region containing itself. This allows us to partition images into multiple source regions, a capability achieved for the first time. Additionally, rather than memorizing certain forgery traces, SAFIRE naturally focuses on uniform characteristics within each source region. This approach leads to more stable and effective learning, achieving superior performance in both the new task and the traditional binary forgery localization.

Myung-Joon Kwon, Wonjun Lee, Seung-Hun Nam, Minji Son, Changick Kim• 2024

Related benchmarks

TaskDatasetResultRank
Image Forgery LocalizationColumbia Unseen Domain
mIoU40.5
30
Image-level Forgery DetectionColumbia
F1 Score66.54
24
Image Manipulation LocalizationMagicBrush
F1 Score48.5
21
Image Forgery LocalizationCASIA v1
Pixel-level AUC61.6
20
Pixel-level Forgery LocalizationCocoGlide
F1 Score47.1
20
Pixel-level Forgery LocalizationColumbia
F175.2
20
Image Forgery DetectionCocoGlide
Accuracy50.1
20
Pixel-level Forgery LocalizationCoverage
F1 Score57.57
19
Image Forgery LocalizationIMD 2020
DSC53.1
15
Image Forgery LocalizationIMD Unseen Domain 2020
mIoU41.1
15
Showing 10 of 57 rows

Other info

Follow for update