Topological Understanding of Neural Networks, a survey

01/23/2023
by   Tushar Pandey, et al.
0

We look at the internal structure of neural networks which is usually treated as a black box. The easiest and the most comprehensible thing to do is to look at a binary classification and try to understand the approach a neural network takes. We review the significance of different activation functions, types of network architectures associated to them, and some empirical data. We find some interesting observations and a possibility to build upon the ideas to verify the process for real datasets. We suggest some possible experiments to look forward to in three different directions.

READ FULL TEXT

page 4

page 10

research
02/28/2022

An Analytical Approach to Compute the Exact Preimage of Feed-Forward Neural Networks

Neural networks are a convenient way to automatically fit functions that...
research
12/08/2016

Geometric Decomposition of Feed Forward Neural Networks

There have been several attempts to mathematically understand neural net...
research
11/23/2020

A Use of Even Activation Functions in Neural Networks

Despite broad interest in applying deep learning techniques to scientifi...
research
07/07/2020

An Integer Programming Approach to Deep Neural Networks with Binary Activation Functions

We study deep neural networks with binary activation functions (BDNN), i...
research
06/13/2020

Understanding Learning Dynamics of Binary Neural Networks via Information Bottleneck

Compact neural networks are essential for affordable and power efficient...
research
10/17/2020

Squashing activation functions in benchmark tests: towards eXplainable Artificial Intelligence using continuous-valued logic

Over the past few years, deep neural networks have shown excellent resul...
research
11/22/2022

Interpreting Neural Networks through the Polytope Lens

Mechanistic interpretability aims to explain what a neural network has l...

Please sign up or login with your details

Forgot password? Click here to reset