NEWRON: A New Generalization of the Artificial Neuron to Enhance the Interpretability of Neural Networks

10/05/2021
by   Federico Siciliano, et al.
0

In this work, we formulate NEWRON: a generalization of the McCulloch-Pitts neuron structure. This new framework aims to explore additional desirable properties of artificial neurons. We show that some specializations of NEWRON allow the network to be interpretable with no change in their expressiveness. By just inspecting the models produced by our NEWRON-based networks, we can understand the rules governing the task. Extensive experiments show that the quality of the generated models is better than traditional interpretable models and in line or better than standard neural networks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/23/2019

Improving Neural Networks by Adopting Amplifying and Attenuating Neurons

In the present study, an amplifying neuron and attenuating neuron, which...
research
11/30/2021

Neuron with Steady Response Leads to Better Generalization

Regularization can mitigate the generalization gap between training and ...
research
05/04/2023

Seeing is Believing: Brain-Inspired Modular Training for Mechanistic Interpretability

We introduce Brain-Inspired Modular Training (BIMT), a method for making...
research
06/02/2020

An Informal Introduction to Multiplet Neural Networks

In the artificial neuron, I replace the dot product with the weighted Le...
research
08/20/2020

Prototype-based interpretation of the functionality of neurons in winner-take-all neural networks

Prototype-based learning (PbL) using a winner-take-all (WTA) network bas...
research
02/23/2020

Neuron Shapley: Discovering the Responsible Neurons

We develop Neuron Shapley as a new framework to quantify the contributio...
research
06/26/2017

Towards the Evolution of Multi-Layered Neural Networks: A Dynamic Structured Grammatical Evolution Approach

Current grammar-based NeuroEvolution approaches have several shortcoming...

Please sign up or login with your details

Forgot password? Click here to reset