An ELU Network with Total Variation for Image Denoising

by   Tianyang Wang, et al.

In this paper, we propose a novel convolutional neural network (CNN) for image denoising, which uses exponential linear unit (ELU) as the activation function. We investigate the suitability by analyzing ELU's connection with trainable nonlinear reaction diffusion model (TNRD) and residual denoising. On the other hand, batch normalization (BN) is indispensable for residual denoising and convergence purpose. However, direct stacking of BN and ELU degrades the performance of CNN. To mitigate this issue, we design an innovative combination of activation layer and normalization layer to exploit and leverage the ELU network, and discuss the corresponding rationale. Moreover, inspired by the fact that minimizing total variation (TV) can be applied to image denoising, we propose a TV regularized L2 loss to evaluate the training effect during the iterations. Finally, we conduct extensive experiments, showing that our model outperforms some recent and popular approaches on Gaussian denoising with specific or randomized noise levels for both gray and color images.



There are no comments yet.


page 8

page 9


Spatial-Frequency Domain Nonlocal Total Variation for Image Denoising

Following the pioneering works of Rudin, Osher and Fatemi on total varia...

Image Restoration using Total Variation Regularized Deep Image Prior

In the past decade, sparsity-driven regularization has led to significan...

Rectifier Neural Network with a Dual-Pathway Architecture for Image Denoising

Recently deep neural networks based on tanh activation function have sho...

A Residual Solver and Its Unfolding Neural Network for Total Variation Regularized Models

This paper proposes to solve the Total Variation regularized models by f...

Nonlocality-Reinforced Convolutional Neural Networks for Image Denoising

We introduce a paradigm for nonlocal sparsity reinforced deep convolutio...

Total Variation Optimization Layers for Computer Vision

Optimization within a layer of a deep-net has emerged as a new direction...

Unrolling of Deep Graph Total Variation for Image Denoising

While deep learning (DL) architectures like convolutional neural network...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.