Contrastive Learning with Large Memory Bank and Negative Embedding Subtraction for Accurate Copy Detection
About
Copy detection, which is a task to determine whether an image is a modified copy of any image in a database, is an unsolved problem. Thus, we addressed copy detection by training convolutional neural networks (CNNs) with contrastive learning. Training with a large memory-bank and hard data augmentation enables the CNNs to obtain more discriminative representation. Our proposed negative embedding subtraction further boosts the copy detection accuracy. Using our methods, we achieved 1st place in the Facebook AI Image Similarity Challenge: Descriptor Track. Our code is publicly available here: \url{https://github.com/lyakaap/ISC21-Descriptor-Track-1st}
Shuhei Yokoo• 2021
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Image Copy Detection | SD 1.5 (test) | Average Similarity0.201 | 28 | |
| Image Copy Detection | Midjourney (test) | Average Similarity31.1 | 28 | |
| Image Copy Detection | DALL-E 2 (test) | Average Similarity0.27 | 28 | |
| Image Copy Detection | New Bing (test) | Average Similarity0.279 | 28 | |
| Image Copy Detection | SDXL (test) | Avg Similarity35.8 | 28 | |
| Image Copy Detection | GLIDE (test) | Average Similarity0.349 | 28 | |
| Image Copy Detection | DeepFloyd IF (test) | Average Similarity34.7 | 28 | |
| ICDiff | D-Rep (test) | PCC19.1 | 20 | |
| Image Copy Detection (Descriptor) | DISC 2021 (test) | μAP64.3 | 14 | |
| Copy detection | AnyPattern (test) | µAP13.8 | 8 |
Showing 10 of 10 rows