Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

SAFIRE: Segment Any Forged Image Region

About

Most techniques approach the problem of image forgery localization as a binary segmentation task, training neural networks to label original areas as 0 and forged areas as 1. In contrast, we tackle this issue from a more fundamental perspective by partitioning images according to their originating sources. To this end, we propose Segment Any Forged Image Region (SAFIRE), which solves forgery localization using point prompting. Each point on an image is used to segment the source region containing itself. This allows us to partition images into multiple source regions, a capability achieved for the first time. Additionally, rather than memorizing certain forgery traces, SAFIRE naturally focuses on uniform characteristics within each source region. This approach leads to more stable and effective learning, achieving superior performance in both the new task and the traditional binary forgery localization.

Myung-Joon Kwon, Wonjun Lee, Seung-Hun Nam, Minji Son, Changick Kim• 2024

Related benchmarks

TaskDatasetResultRank
Image Forgery DetectionCocoGlide--
15
Image-level Forgery DetectionKorus
F1 Score66.57
11
Pixel-level Forgery LocalizationKorus
F1 Score34.31
11
Image-level Forgery Detectionin the wild
F1 Score100
11
Pixel-level Forgery LocalizationCoverage
F1 Score57.57
11
Pixel-level Forgery LocalizationCocoGlide
F1 Score47.1
11
Pixel-level Forgery LocalizationNIST 16
F1 Score0.4177
11
Pixel-level Forgery LocalizationDSO
F1 Score45.78
11
Pixel-level Forgery LocalizationColumbia
F175.2
11
Image-level Forgery DetectionCoverage
F1 Score66.45
11
Showing 10 of 26 rows

Other info

Follow for update