An Analytical Approach to Compute the Exact Preimage of Feed-Forward Neural Networks

02/28/2022
by   Théo Nancy, et al.
0

Neural networks are a convenient way to automatically fit functions that are too complex to be described by hand. The downside of this approach is that it leads to build a black-box without understanding what happened inside. Finding the preimage would help to better understand how and why such neural networks had given such outputs. Because most of the neural networks are noninjective function, it is often impossible to compute it entirely only by a numerical way. The point of this study is to give a method to compute the exact preimage of any Feed-Forward Neural Network with linear or piecewise linear activation functions for hidden layers. In contrast to other methods, this one is not returning a unique solution for a unique output but returns analytically the entire and exact preimage.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/08/2016

Geometric Decomposition of Feed Forward Neural Networks

There have been several attempts to mathematically understand neural net...
research
01/23/2023

Topological Understanding of Neural Networks, a survey

We look at the internal structure of neural networks which is usually tr...
research
02/12/2020

Fast Geometric Projections for Local Robustness Certification

Local robustness ensures that a model classifies all inputs within an ϵ-...
research
08/11/2023

Noise-Resilient Designs for Optical Neural Networks

All analog signal processing is fundamentally subject to noise, and this...
research
10/08/2018

Neural Network based classification of bone metastasis by primary cacinoma

Neural networks have been known for a long time as a tool for different ...
research
10/10/2016

Extrapolation and learning equations

In classical machine learning, regression is treated as a black box proc...
research
03/02/2020

Reachability Analysis for Feed-Forward Neural Networks using Face Lattices

Deep neural networks have been widely applied as an effective approach t...

Please sign up or login with your details

Forgot password? Click here to reset