On an Interpretation of ResNets via Solution Constructions

12/12/2022
by   Changcun Huang, et al.
0

This paper first constructs a typical solution of ResNets for multi-category classifications by the principle of gate-network controls and deep-layer classifications, from which a general interpretation of the ResNet architecture is given and the performance mechanism is explained. We then use more solutions to further demonstrate the generality of that interpretation. The universal-approximation capability of ResNets is proved.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/16/2022

Universal Solutions of Feedforward ReLU Networks for Interpolations

This paper provides a theoretical framework on the solution of feedforwa...
research
12/03/2019

On the Herbrand Functional Interpretation

We show that the types of the witnesses in the Herbrand functional inter...
research
01/10/2020

A computational interpretation of Zorn's lemma

We give a computational interpretation to an abstract instance of Zorn's...
research
03/09/2021

Deep neural network approximation for high-dimensional parabolic Hamilton-Jacobi-Bellman equations

The approximation of solutions to second order Hamilton–Jacobi–Bellman (...
research
11/06/2017

Interpretable Feature Recommendation for Signal Analytics

This paper presents an automated approach for interpretable feature reco...
research
12/28/2018

Sequential algorithms and the computational content of classical proofs

We develop a correspondence between the theory of sequential algorithms ...
research
10/14/2018

Monads, partial evaluations, and rewriting

Monads can be interpreted as encoding formal expressions, or formal oper...

Please sign up or login with your details

Forgot password? Click here to reset