research
∙
09/15/2023
Replacing softmax with ReLU in Vision Transformers
Previous research observed accuracy degradation when replacing the atten...
share
research
∙
11/22/2022
Time Series Forecasting with Hypernetworks Generating Parameters in Advance
Forecasting future outcomes from recent time series data is not easy, es...
research
∙
11/08/2018
Measuring the Effects of Data Parallelism on Neural Network Training
Recent hardware developments have made unprecedented amounts of data par...
research
∙
11/01/2017
