Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Contrastive Learning with Large Memory Bank and Negative Embedding Subtraction for Accurate Copy Detection

About

Copy detection, which is a task to determine whether an image is a modified copy of any image in a database, is an unsolved problem. Thus, we addressed copy detection by training convolutional neural networks (CNNs) with contrastive learning. Training with a large memory-bank and hard data augmentation enables the CNNs to obtain more discriminative representation. Our proposed negative embedding subtraction further boosts the copy detection accuracy. Using our methods, we achieved 1st place in the Facebook AI Image Similarity Challenge: Descriptor Track. Our code is publicly available here: \url{https://github.com/lyakaap/ISC21-Descriptor-Track-1st}

Shuhei Yokoo• 2021

Related benchmarks

TaskDatasetResultRank
Image Copy DetectionSD 1.5 (test)
Average Similarity0.201
28
Image Copy DetectionMidjourney (test)
Average Similarity31.1
28
Image Copy DetectionDALL-E 2 (test)
Average Similarity0.27
28
Image Copy DetectionNew Bing (test)
Average Similarity0.279
28
Image Copy DetectionSDXL (test)
Avg Similarity35.8
28
Image Copy DetectionGLIDE (test)
Average Similarity0.349
28
Image Copy DetectionDeepFloyd IF (test)
Average Similarity34.7
28
ICDiffD-Rep (test)
PCC19.1
20
Image Copy Detection (Descriptor)DISC 2021 (test)
μAP64.3
14
Copy detectionAnyPattern (test)
µAP13.8
8
Showing 10 of 10 rows

Other info

Follow for update