research
∙
11/23/2019
A Stochastic Tensor Method for Non-convex Optimization
We present a stochastic optimization method that uses a fourth-order reg...
share
research
∙
07/02/2019
The Role of Memory in Stochastic Optimization
The choice of how to retain information about past gradients dramaticall...
research
∙
05/22/2019
Ellipsoidal Trust Region Methods and the Marginal Value of Hessian Information for Neural Network Training
We investigate the use of ellipsoidal trust region constraints for secon...
research
∙
05/27/2018
Towards a Theoretical Understanding of Batch Normalization
Normalization techniques such as Batch Normalization have been applied v...
research
∙
03/15/2018
