research
∙
05/15/2022
Guidelines for the Regularization of Gammas in Batch Normalization for Deep Residual Networks
L2 regularization for weights in neural networks is widely used as a sta...
share
research
∙
11/16/2021
Improved Robustness of Vision Transformer via PreLayerNorm in Patch Embedding
Vision transformers (ViTs) have recently demonstrated state-of-the-art p...
research
∙
08/31/2021
