-
Dynamics of stochastic gradient descent for two-layer neural networks in the teacher-student setup
Deep neural networks achieve stellar generalisation even when they have ...
06/18/2019 ∙ by Sebastian Goldt, et al. ∙
11
∙
share
read it
-
Generalisation dynamics of online learning in over-parameterised neural networks
Deep neural networks achieve stellar generalisation on a variety of prob...
01/25/2019 ∙ by Sebastian Goldt, et al. ∙
12
∙
share
read it
-
Energy-entropy competition and the effectiveness of stochastic gradient descent in machine learning
Finding parameters that minimise a loss function is at the core of many ...
03/05/2018 ∙ by Yao Zhang, et al. ∙
0
∙
share
read it
-
High-dimensional dynamics of generalization error in neural networks
We perform an average case analysis of the generalization dynamics of la...
10/10/2017 ∙ by Madhu S. Advani, et al. ∙
0
∙
share
read it
