research
∙
06/29/2023
Efficient Sobolev approximation of linear parabolic PDEs in high dimensions
In this paper, we study the error in first order Sobolev norm in the app...
research
∙
08/03/2022
Gradient descent provably escapes saddle points in the training of shallow ReLU networks
Dynamical systems theory has recently been applied in optimization to pr...
research
∙
03/19/2021
Landscape analysis for shallow ReLU neural networks: complete classification of critical points for affine target functions
In this paper, we analyze the landscape of the true loss of a ReLU neura...
research
∙
02/19/2021
A proof of convergence for gradient descent in the training of artificial neural networks for constant target functions
Gradient descent optimization algorithms are the standard ingredients th...
research
∙
06/12/2020
Non-convergence of stochastic gradient descent in the training of deep neural networks
Deep neural networks have successfully been trained in various applicati...
research
∙
12/09/2019