Topological Structure is Predictive of Deep Neural Network Success in Learning

01/23/2023
by   Christopher Griffin, et al.
0

Machine learning has become a fundamental tool in modern science, yet its limitations are still not fully understood. Using a simple children's game, we show that the topological structure of the underlying training data can have a dramatic effect on the ability of a deep neural network (DNN) classifier to learn to classify data. We then take insights obtained from this toy model and apply them to two physical data sets (one from particle physics and one from acoustics), which are known to be amenable to classification by DNN's. We show that the simplicity in their topological structure explains the majority of the DNN's ability to operate on these data sets by showing that fully interpretable topological classifiers are able to perform nearly as well as their DNN counterparts.

READ FULL TEXT

page 1

page 3

research
04/03/2018

Analysis on the Nonlinear Dynamics of Deep Neural Networks: Topological Entropy and Chaos

The theoretical explanation for deep neural network (DNN) is still an op...
research
11/30/2021

Leveraging The Topological Consistencies of Learning in Deep Neural Networks

Recently, methods have been developed to accurately predict the testing ...
research
10/19/2021

Activation Landscapes as a Topological Summary of Neural Network Performance

We use topological data analysis (TDA) to study how data transforms as i...
research
05/26/2023

Universal Approximation and the Topological Neural Network

A topological neural network (TNN), which takes data from a Tychonoff to...
research
06/27/2018

TopoReg: A Topological Regularizer for Classifiers

Regularization plays a crucial role in supervised learning. A successful...
research
08/02/2023

Using ScrutinAI for Visual Inspection of DNN Performance in a Medical Use Case

Our Visual Analytics (VA) tool ScrutinAI supports human analysts to inve...

Please sign up or login with your details

Forgot password? Click here to reset