Image denoising and restoration with CNN-LSTM Encoder Decoder with Direct Attention

01/16/2018
by   Kazi Nazmul Haque, et al.
0

Image denoising is always a challenging task in the field of computer vision and image processing. In this paper, we have proposed an encoder-decoder model with direct attention, which is capable of denoising and reconstruct highly corrupted images. Our model consists of an encoder and a decoder, where the encoder is a convolutional neural network and decoder is a multilayer Long Short-Term memory network. In the proposed model, the encoder reads an image and catches the abstraction of that image in a vector, where decoder takes that vector as well as the corrupted image to reconstruct a clean image. We have trained our model on MNIST handwritten digit database after making lower half of every image as black as well as adding noise top of that. After a massive destruction of the images where it is hard for a human to understand the content of those images, our model can retrieve that image with minimal error. Our proposed model has been compared with convolutional encoder-decoder, where our model has performed better at generating missing part of the images than convolutional autoencoder.

READ FULL TEXT

page 3

page 4

page 5

page 8

page 10

research
11/01/2018

A sequential guiding network with attention for image captioning

The recent advances of deep learning in both computer vision (CV)and nat...
research
05/01/2021

Blind microscopy image denoising with a deep residual and multiscale encoder/decoder network

In computer-aided diagnosis (CAD) focused on microscopy, denoising impro...
research
12/18/2019

The Spectral Bias of the Deep Image Prior

The "deep image prior" proposed by Ulyanov et al. is an intriguing prope...
research
10/25/2021

Learning Continuous Face Representation with Explicit Functions

How to represent a face pattern? While it is presented in a continuous w...
research
04/28/2018

CRAM: Clued Recurrent Attention Model

To overcome the poor scalability of convolutional neural network, recurr...
research
12/27/2016

Learning Non-Lambertian Object Intrinsics across ShapeNet Categories

We consider the non-Lambertian object intrinsic problem of recovering di...
research
04/16/2020

Distributed Evolution of Deep Autoencoders

Autoencoders have seen wide success in domains ranging from feature sele...

Please sign up or login with your details

Forgot password? Click here to reset