Hybrid LSTM and Encoder-Decoder Architecture for Detection of Image Forgeries

03/06/2019
by   Jawadul H. Bappy, et al.
0

With advanced image journaling tools, one can easily alter the semantic meaning of an image by exploiting certain manipulation techniques such as copy-clone, object splicing, and removal, which mislead the viewers. In contrast, the identification of these manipulations becomes a very challenging task as manipulated regions are not visually apparent. This paper proposes a high-confidence manipulation localization architecture which utilizes resampling features, Long-Short Term Memory (LSTM) cells, and encoder-decoder network to segment out manipulated regions from non-manipulated ones. Resampling features are used to capture artifacts like JPEG quality loss, upsampling, downsampling, rotation, and shearing. The proposed network exploits larger receptive fields (spatial maps) and frequency domain correlation to analyze the discriminative characteristics between manipulated and non-manipulated regions by incorporating encoder and LSTM network. Finally, decoder network learns the mapping from low-resolution feature maps to pixel-wise predictions for image tamper localization. With predicted mask provided by final layer (softmax) of the proposed architecture, end-to-end training is performed to learn the network parameters through back-propagation using ground-truth masks. Furthermore, a large image splicing dataset is introduced to guide the training process. The proposed method is capable of localizing image manipulations at pixel level with high precision, which is demonstrated through rigorous experimentation on three diverse datasets.

READ FULL TEXT

page 2

page 3

page 5

page 7

page 8

page 9

page 10

research
09/27/2020

Two-stream Encoder-Decoder Network for Localizing Image Forgeries

This paper proposes a novel two-stream encoder-decoder network, which ut...
research
07/01/2020

Automatic Crack Detection on Road Pavements Using Encoder Decoder Architecture

Inspired by the development of deep learning in computer vision and obje...
research
04/16/2022

GAUSS: Guided Encoder-Decoder Architecture for Hyperspectral Unmixing with Spatial Smoothness

In recent hyperspectral unmixing (HU) literature, the application of dee...
research
08/29/2019

Translating Mathematical Formula Images to LaTeX Sequences Using Deep Neural Networks with Sequence-level Training

In this paper we propose a deep neural network model with an encoder-dec...
research
09/02/2019

Dynamic Approach for Lane Detection using Google Street View and CNN

Lane detection algorithms have been the key enablers for a fully-assisti...
research
03/19/2021

PSCC-Net: Progressive Spatio-Channel Correlation Network for Image Manipulation Detection and Localization

To defend against manipulation of image content, such as splicing, copy-...
research
03/31/2018

Gated Fusion Network for Single Image Dehazing

In this paper, we propose an efficient algorithm to directly restore a c...

Please sign up or login with your details

Forgot password? Click here to reset