Learning Enhancement of CNNs via Separation Index Maximizing at the First Convolutional Layer

01/13/2022
by   Ali Karimi, et al.
0

In this paper, a straightforward enhancement learning algorithm based on Separation Index (SI) concept is proposed for Convolutional Neural Networks (CNNs). At first, the SI as a supervised complexity measure is explained its usage in better learning of CNNs for classification problems illustrate. Then, a learning strategy proposes through which the first layer of a CNN is optimized by maximizing the SI, and the further layers are trained through the backpropagation algorithm to learn further layers. In order to maximize the SI at the first layer, A variant of ranking loss is optimized by using the quasi least square error technique. Applying such a learning strategy to some known CNNs and datasets, its enhancement impact in almost all cases is demonstrated.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/12/2019

Evaluation of Dataflow through layers of Deep Neural Networks in Classification and Regression Problems

This paper introduces two straightforward, effective indices to evaluate...
research
02/06/2020

Fixed smooth convolutional layer for avoiding checkerboard artifacts in CNNs

In this paper, we propose a fixed convolutional layer with an order of s...
research
10/02/2017

Interpretable Convolutional Neural Networks

This paper proposes a method to modify traditional convolutional neural ...
research
02/27/2020

Deep Residual-Dense Lattice Network for Speech Enhancement

Convolutional neural networks (CNNs) with residual links (ResNets) and c...
research
10/28/2022

Introducing topography in convolutional neural networks

Parts of the brain that carry sensory tasks are organized topographicall...
research
06/27/2020

A Retinex based GAN Pipeline to Utilize Paired and Unpaired Datasets for Enhancing Low Light Images

Low light image enhancement is an important challenge for the developmen...
research
11/29/2018

Deep learning for pedestrians: backpropagation in CNNs

The goal of this document is to provide a pedagogical introduction to th...

Please sign up or login with your details

Forgot password? Click here to reset