research
∙
05/25/2023
Stochastic Modified Equations and Dynamics of Dropout Algorithm
Dropout is a widely utilized regularization technique in the training of...
share
research
∙
05/17/2023
Understanding the Initial Condensation of Convolutional Neural Networks
Previous research has shown that fully-connected networks with small ini...
research
∙
05/11/2023
Numerical Stability for Differential Equations with Memory
In this work, we systematically investigate linear multi-step methods fo...
research
∙
03/12/2023
Phase Diagram of Initial Condensation for Two-layer Neural Networks
The phenomenon of distinct behaviors exhibited by neural networks under ...
research
∙
11/30/2021
Embedding Principle: a hierarchical structure of loss landscape of deep neural networks
We prove a general Embedding Principle of loss landscape of deep neural ...
research
∙
03/30/2021
Nonlinear Weighted Directed Acyclic Graph and A Priori Estimates for Neural Networks
In an attempt to better understand structural benefits and generalizatio...
research
∙
07/07/2020
Towards an Understanding of Residual Networks Using Neural Tangent Hierarchy (NTH)
Gradient descent yields zero training loss in polynomial time for deep n...
research
∙
11/19/2017