Artificial Neural Network Pruning to Extract Knowledge

05/13/2020
by   Evgeny M. Mirkes, et al.
0

Artificial Neural Networks (NN) are widely used for solving complex problems from medical diagnostics to face recognition. Despite notable successes, the main disadvantages of NN are also well known: the risk of overfitting, lack of explainability (inability to extract algorithms from trained NN), and high consumption of computing resources. Determining the appropriate specific NN structure for each problem can help overcome these difficulties: Too poor NN cannot be successfully trained, but too rich NN gives unexplainable results and may have a high chance of overfitting. Reducing precision of NN parameters simplifies the implementation of these NN, saves computing resources, and makes the NN skills more transparent. This paper lists the basic NN simplification problems and controlled pruning procedures to solve these problems. All the described pruning procedures can be implemented in one framework. The developed procedures, in particular, find the optimal structure of NN for each task, measure the influence of each input signal and NN parameter, and provide a detailed verbal description of the algorithms and skills of NN. The described methods are illustrated by a simple example: the generation of explicit algorithms for predicting the results of the US presidential election.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/26/2018

Using stigmergy to incorporate the time into artificial neural networks

A current research trend in neurocomputing involves the design of novel ...
research
12/06/2017

Achieving the time of 1-NN, but the accuracy of k-NN

We propose a simple approach which, given distributed computing resource...
research
01/22/2021

Baseline Pruning-Based Approach to Trojan Detection in Neural Networks

This paper addresses the problem of detecting trojans in neural networks...
research
07/16/2014

Data Assimilation by Artificial Neural Networks for an Atmospheric General Circulation Model: Conventional Observation

This paper presents an approach for employing artificial neural networks...
research
08/26/2022

Reducing Computational Complexity of Neural Networks in Optical Channel Equalization: From Concepts to Implementation

In this paper, a new methodology is proposed that allows for the low-com...
research
05/22/2020

Premium Access to Convolutional Neural Networks

Neural Networks (NNs) are today used for all our daily tasks; for instan...

Please sign up or login with your details

Forgot password? Click here to reset