research
∙
10/14/2020
Temperature check: theory and practice for training models with softmax-cross-entropy losses
The softmax function combined with a cross-entropy loss is a principled ...
share
research
∙
11/13/2017
Resurrecting the sigmoid in deep learning through dynamical isometry: theory and practice
It is well known that the initialization of weights in deep neural netwo...
research
∙
11/01/2017
