SISL:Self-Supervised Image Signature Learning for Splicing Detection and Localization

03/15/2022
by   Susmit Agrawal, et al.
2

Recent algorithms for image manipulation detection almost exclusively use deep network models. These approaches require either dense pixelwise groundtruth masks, camera ids, or image metadata to train the networks. On one hand, constructing a training set to represent the countless tampering possibilities is impractical. On the other hand, social media platforms or commercial applications are often constrained to remove camera ids as well as metadata from images. A self-supervised algorithm for training manipulation detection models without dense groundtruth or camera/image metadata would be extremely useful for many forensics applications. In this paper, we propose self-supervised approach for training splicing detection/localization models from frequency transforms of images. To identify the spliced regions, our deep network learns a representation to capture an image specific signature by enforcing (image) self consistency . We experimentally demonstrate that our proposed model can yield similar or better performances of multiple existing methods on standard datasets without relying on labels or metadata.

READ FULL TEXT

page 4

page 7

page 8

research
01/11/2023

EXIF as Language: Learning Cross-Modal Associations Between Images and Camera Metadata

We learn a visual representation that captures information about the cam...
research
02/18/2020

MAST: A Memory-Augmented Self-supervised Tracker

Recent interest in self-supervised dense tracking has yielded rapid prog...
research
12/09/2020

Self-supervised Human Detection and Segmentation via Multi-view Consensus

Self-supervised detection and segmentation of foreground objects in comp...
research
09/12/2022

Learning Dense Visual Descriptors using Image Augmentations for Robot Manipulation Tasks

We propose a self-supervised training approach for learning view-invaria...
research
04/06/2022

LEAD: Self-Supervised Landmark Estimation by Aligning Distributions of Feature Similarity

In this work, we introduce LEAD, an approach to discover landmarks from ...
research
05/10/2018

Fighting Fake News: Image Splice Detection via Learned Self-Consistency

Advances in photo editing and manipulation tools have made it significan...
research
11/20/2019

Scalable and Generalizable Social Bot Detection through Data Selection

Efficient and reliable social bot classification is crucial for detectin...

Please sign up or login with your details

Forgot password? Click here to reset