research
∙
11/27/2020
Progressively Stacking 2.0: A Multi-stage Layerwise Training Method for BERT Training Speedup
Pre-trained language models, such as BERT, have achieved significant acc...
share
research
∙
11/27/2020
CoRe: An Efficient Coarse-refined Training Framework for BERT
In recent years, BERT has made significant breakthroughs on many natural...
research
∙
01/24/2018
PRNN: Recurrent Neural Network with Persistent Memory
Although Recurrent Neural Network (RNN) has been a powerful tool for mod...
research
∙
12/22/2017