research
∙
03/06/2023
On the existence of optimal shallow feedforward networks with ReLU activation
We prove existence of global minima in the loss landscape for the approx...
share
research
∙
02/28/2023
On the existence of minimizers in shallow residual ReLU neural network optimization landscapes
Many mathematical convergence results for gradient descent (GD) based al...
research
∙
02/14/2023
Stochastic Modified Flows, Mean-Field Limits and Dynamics of Stochastic Gradient Descent
We propose new limiting dynamics for stochastic gradient descent in the ...
research
∙
02/07/2023
Convergence rates for momentum stochastic gradient descent with noise of machine learning type
We consider the momentum stochastic gradient descent scheme (MSGD) and i...
research
∙
02/16/2021
Convergence of stochastic gradient descent schemes for Lojasiewicz-landscapes
In this article, we consider convergence of stochastic gradient descent ...
research
∙
12/19/2019