Deep Learning Methods for Event Verification and Image Repurposing Detection

02/11/2019
by   M. Goebel, et al.
26

The authenticity of images posted on social media is an issue of growing concern. Many algorithms have been developed to detect manipulated images, but few have investigated the ability of deep neural network based approaches to verify the authenticity of image labels, such as event names. In this paper, we propose several novel methods to predict if an image was captured at one of several noteworthy events. We use a set of images from several recorded events such as storms, marathons, protests, and other large public gatherings. Two strategies of applying pre-trained Imagenet network for event verification are presented, with two modifications for each strategy. The first method uses the features from the last convolutional layer of a pre-trained network as input to a classifier. We also consider the effects of tuning the convolutional weights of the pre-trained network to improve classification. The second method combines many features extracted from smaller scales and uses the output of a pre-trained network as the input to a second classifier. For both methods, we investigated several different classifiers and tested many different pre-trained networks. Our experiments demonstrate both these approaches are effective for event verification and image re-purposing detection. The classification at the global scale tends to marginally outperform our tested local methods and fine tuning the network further improves the results.

READ FULL TEXT

page 3

page 5

page 6

page 7

research
11/13/2017

An Automatic Diagnosis Method of Facial Acne Vulgaris Based on Convolutional Neural Network

In this paper, we present a new automatic diagnosis method of facial acn...
research
04/07/2016

Families in the Wild (FIW): Large-Scale Kinship Image Database and Benchmarks

We present the largest kinship recognition dataset to date, Families in ...
research
04/29/2020

Classification of Equation of State in Relativistic Heavy-Ion Collisions Using Deep Learning

Convolutional Neural Nets, which is a powerful method of Deep Learning, ...
research
12/20/2013

Competitive Learning with Feedforward Supervisory Signal for Pre-trained Multilayered Networks

We propose a novel learning method for multilayered neural networks whic...
research
05/22/2023

Registering Neural Radiance Fields as 3D Density Images

No significant work has been done to directly merge two partially overla...
research
12/18/2019

A Web Page Classifier Library Based on Random Image Content Analysis Using Deep Learning

In this paper, we present a methodology and the corresponding Python lib...
research
01/10/2019

Automatic detection of passable roads after floods in remote sensed and social media data

This paper addresses the problem of floods classification and floods aft...

Please sign up or login with your details

Forgot password? Click here to reset