Convergence Rates for Multi-classs Logistic Regression Near Minimum

12/08/2020

∙

by   Dwight Nwaigwe, et al.

∙

0

∙

share

Training a neural network is typically done via variations of gradient descent. If a minimum of the loss function exists and gradient descent is used as the training method, we provide an expression that relates learning rate to the rate of convergence to the minimum. We also discuss existence of a minimum.