AI Chat AI Image Generator AI Video Text to Speech

Analysis on the Nonlinear Dynamics of Deep Neural Networks: Topological Entropy and Chaos

04/03/2018

∙

by Husheng Li, et al.

∙

∙

The theoretical explanation for deep neural network (DNN) is still an open problem. In this paper DNN is considered as a discrete-time dynamical system due to its layered structure. The complexity provided by the nonlinearity in the dynamics is analyzed in terms of topological entropy and chaos characterized by Lyapunov exponents. The properties revealed for the dynamics of DNN are applied to analyze the corresponding capabilities of classification and generalization.

page 1

page 2

page 3

page 4

research

∙ 01/23/2023

Topological Structure is Predictive of Deep Neural Network Success in Learning

Machine learning has become a fundamental tool in modern science, yet it...

0 Christopher Griffin, et al. ∙

research

∙ 10/15/2020

Depth-Width Trade-offs for Neural Networks via Topological Entropy

One of the central problems in the study of deep learning theory is to u...

0 Kaifeng Bu, et al. ∙

research

∙ 12/07/2020

Inter-layer Information Similarity Assessment of Deep Neural Networks Via Topological Similarity and Persistence Analysis of Data Neighbour Dynamics

The quantitative analysis of information structure through a deep neural...

0 Andrew Hryniowski, et al. ∙

research

∙ 11/30/2021

Leveraging The Topological Consistencies of Learning in Deep Neural Networks

Recently, methods have been developed to accurately predict the testing ...

21 Stuart Synakowski, et al. ∙

research

∙ 02/12/2015

Over-Sampling in a Deep Neural Network

Deep neural networks (DNN) are the state of the art on many engineering ...

0 Andrew J. R. Simpson, et al. ∙

research

∙ 05/22/2021

Embedding Information onto a Dynamical System

The celebrated Takens' embedding theorem concerns embedding an attractor...

0 G Manjunath, et al. ∙

research

∙ 12/11/2019

On Neural Learnability of Chaotic Dynamics

Neural networks are of interest for prediction and uncertainty quantific...

0 Ziwei Li, et al. ∙