An ELU Network with Total Variation for Image Denoising

08/14/2017
by   Tianyang Wang, et al.
0

In this paper, we propose a novel convolutional neural network (CNN) for image denoising, which uses exponential linear unit (ELU) as the activation function. We investigate the suitability by analyzing ELU's connection with trainable nonlinear reaction diffusion model (TNRD) and residual denoising. On the other hand, batch normalization (BN) is indispensable for residual denoising and convergence purpose. However, direct stacking of BN and ELU degrades the performance of CNN. To mitigate this issue, we design an innovative combination of activation layer and normalization layer to exploit and leverage the ELU network, and discuss the corresponding rationale. Moreover, inspired by the fact that minimizing total variation (TV) can be applied to image denoising, we propose a TV regularized L2 loss to evaluate the training effect during the iterations. Finally, we conduct extensive experiments, showing that our model outperforms some recent and popular approaches on Gaussian denoising with specific or randomized noise levels for both gray and color images.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 8

page 9

12/05/2019

Spatial-Frequency Domain Nonlocal Total Variation for Image Denoising

Following the pioneering works of Rudin, Osher and Fatemi on total varia...
10/30/2018

Image Restoration using Total Variation Regularized Deep Image Prior

In the past decade, sparsity-driven regularization has led to significan...
09/10/2016

Rectifier Neural Network with a Dual-Pathway Architecture for Image Denoising

Recently deep neural networks based on tanh activation function have sho...
09/08/2020

A Residual Solver and Its Unfolding Neural Network for Total Variation Regularized Models

This paper proposes to solve the Total Variation regularized models by f...
03/06/2018

Nonlocality-Reinforced Convolutional Neural Networks for Image Denoising

We introduce a paradigm for nonlocal sparsity reinforced deep convolutio...
04/07/2022

Total Variation Optimization Layers for Computer Vision

Optimization within a layer of a deep-net has emerged as a new direction...
10/21/2020

Unrolling of Deep Graph Total Variation for Image Denoising

While deep learning (DL) architectures like convolutional neural network...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.