Understanding Deep Neural Networks Using Topological Data Analysis

10/31/2018
by   Daniel Goldfarb, et al.
0

Deep neural networks (DNN) are black box algorithms. They are trained using a gradient descent back propagation technique which trains weights in each layer for the sole goal of minimizing training error. Hence, the resulting weights cannot be directly explained. Using Topological Data Analysis (TDA) we can get an insight on how the neural network is thinking, specifically by analyzing the activation values of validation images as they pass through each layer.

READ FULL TEXT

page 3

page 4

page 5

page 7

page 9

page 10

page 11

page 12

research
10/19/2021

Activation Landscapes as a Topological Summary of Neural Network Performance

We use topological data analysis (TDA) to study how data transforms as i...
research
11/02/2018

Topological Approaches to Deep Learning

We perform topological data analysis on the internal states of convoluti...
research
02/21/2019

Topology of Learning in Artificial Neural Networks

Understanding how neural networks learn remains one of the central chall...
research
11/23/2018

Representer Point Selection for Explaining Deep Neural Networks

We propose to explain the predictions of a deep neural network, by point...
research
07/06/2019

Towards Debugging Deep Neural Networks by Generating Speech Utterances

Deep neural networks (DNN) are able to successfully process and classify...
research
01/09/2019

A Constructive Approach for One-Shot Training of Neural Networks Using Hypercube-Based Topological Coverings

In this paper we presented a novel constructive approach for training de...
research
03/23/2022

Towards explaining the generalization gap in neural networks using topological data analysis

Understanding how neural networks generalize on unseen data is crucial f...

Please sign up or login with your details

Forgot password? Click here to reset