A Self-Supervised Descriptor for Image Copy Detection

02/21/2022
by   Ed Pizzi, et al.
0

Image copy detection is an important task for content moderation. We introduce SSCD, a model that builds on a recent self-supervised contrastive training objective. We adapt this method to the copy detection task by changing the architecture and training objective, including a pooling operator from the instance matching literature, and adapting contrastive learning to augmentations that combine images. Our approach relies on an entropy regularization term, promoting consistent separation between descriptor vectors, and we demonstrate that this significantly improves copy detection accuracy. Our method produces a compact descriptor vector, suitable for real-world web scale applications. Statistical information from a background image distribution can be incorporated into the descriptor. On the recent DISC2021 benchmark, SSCD is shown to outperform both baseline copy detection models and self-supervised architectures designed for image classification by huge margins, in all settings. For example, SSCD out-performs SimCLR descriptors by 48

READ FULL TEXT

page 1

page 2

page 12

page 13

research
12/08/2021

Contrastive Learning with Large Memory Bank and Negative Embedding Subtraction for Accurate Copy Detection

Copy detection, which is a task to determine whether an image is a modif...
research
02/08/2022

Results and findings of the 2021 Image Similarity Challenge

The 2021 Image Similarity Challenge introduced a dataset to serve as a n...
research
06/03/2019

Robust copy-move forgery detection by false alarms control

Detecting reliably copy-move forgeries is difficult because images do co...
research
11/13/2021

Bag of Tricks and A Strong baseline for Image Copy Detection

Image copy detection is of great importance in real-life social media. I...
research
11/15/2021

QK Iteration: A Self-Supervised Representation Learning Algorithm for Image Similarity

Self-supervised representation learning is a fundamental problem in comp...
research
07/19/2022

Shrinking the Semantic Gap: Spatial Pooling of Local Moment Invariants for Copy-Move Forgery Detection

Copy-move forgery is a manipulation of copying and pasting specific patc...
research
10/17/2022

Self-Supervised Learning Through Efference Copies

Self-supervised learning (SSL) methods aim to exploit the abundance of u...

Please sign up or login with your details

Forgot password? Click here to reset