Holistic Image Manipulation Detection using Pixel Co-occurrence Matrices

04/12/2021
by   Lakshmanan Nataraj, et al.
0

Digital image forensics aims to detect images that have been digitally manipulated. Realistic image forgeries involve a combination of splicing, resampling, region removal, smoothing and other manipulation methods. While most detection methods in literature focus on detecting a particular type of manipulation, it is challenging to identify doctored images that involve a host of manipulations. In this paper, we propose a novel approach to holistically detect tampered images using a combination of pixel co-occurrence matrices and deep learning. We extract horizontal and vertical co-occurrence matrices on three color channels in the pixel domain and train a model using a deep convolutional neural network (CNN) framework. Our method is agnostic to the type of manipulation and classifies an image as tampered or untampered. We train and validate our model on a dataset of more than 86,000 images. Experimental results show that our approach is promising and achieves more than 0.99 area under the curve (AUC) evaluation metric on the training and validation subsets. Further, our approach also generalizes well and achieves around 0.81 AUC on an unseen test dataset comprising more than 19,740 images released as part of the Media Forensics Challenge (MFC) 2020. Our score was highest among all other teams that participated in the challenge, at the time of announcement of the challenge results.

READ FULL TEXT

page 2

page 3

research
03/15/2019

Detecting GAN generated Fake Images using Co-occurrence Matrices

The advent of Generative Adversarial Networks (GANs) has brought about c...
research
02/09/2018

Boosting Image Forgery Detection using Resampling Detection and Copy-move analysis

Realistic image forgeries involve a combination of splicing, resampling,...
research
07/20/2020

Detection, Attribution and Localization of GAN Generated Images

Recent advances in Generative Adversarial Networks (GANs) have led to th...
research
02/02/2021

Facial Manipulation Detection Based on the Color Distribution Analysis in Edge Region

In this work, we present a generalized and robust facial manipulation de...
research
01/30/2021

Detecting Pulmonary Coccidioidomycosis (Valley fever) with Deep Convolutional Neural Networks

Coccidioidomycosis is the most common systemic mycosis in dogs in the so...
research
04/13/2018

The PS-Battles Dataset - an Image Collection for Image Manipulation Detection

The boost of available digital media has led to a significant increase i...
research
03/01/2018

Resampling Forgery Detection Using Deep Learning and A-Contrario Analysis

The amount of digital imagery recorded has recently grown exponentially,...

Please sign up or login with your details

Forgot password? Click here to reset