Deep Neural Networks as Complex Networks

09/12/2022
by   Emanuele La Malfa, et al.
0

Deep Neural Networks are, from a physical perspective, graphs whose `links` and `vertices` iteratively process data and solve tasks sub-optimally. We use Complex Network Theory (CNT) to represents Deep Neural Networks (DNNs) as directed weighted graphs: within this framework, we introduce metrics to study DNNs as dynamical systems, with a granularity that spans from weights to layers, including neurons. CNT discriminates networks that differ in the number of parameters and neurons, the type of hidden layers and activations, and the objective task. We further show that our metrics discriminate low vs. high performing networks. CNT is a comprehensive method to reason about DNNs and a complementary approach to explain a model's behavior that is physically grounded to networks theory and goes beyond the well-studied input-output relation.

READ FULL TEXT

page 20

page 21

page 26

research
10/06/2021

Characterizing Learning Dynamics of Deep Neural Networks via Complex Networks

In this paper, we interpret Deep Neural Networks with Complex Network Th...
research
11/01/2021

Deep neural networks as nested dynamical systems

There is an analogy that is often made between deep neural networks and ...
research
07/13/2021

The Foes of Neural Network's Data Efficiency Among Unnecessary Input Dimensions

Datasets often contain input dimensions that are unnecessary to predict ...
research
02/13/2018

Information Scaling Law of Deep Neural Networks

With the rapid development of Deep Neural Networks (DNNs), various netwo...
research
01/08/2019

Comments on "Deep Neural Networks with Random Gaussian Weights: A Universal Classification Strategy?"

In a recently published paper [1], it is shown that deep neural networks...
research
09/27/2019

BEAN: Interpretable Representation Learning with Biologically-Enhanced Artificial Neuronal Assembly Regularization

Deep neural networks (DNNs) are known for extracting good representation...
research
05/03/2023

Morphological Classification of Galaxies Using SpinalNet

Deep neural networks (DNNs) with a step-by-step introduction of inputs, ...

Please sign up or login with your details

Forgot password? Click here to reset