research
∙
06/11/2023
GKD: A General Knowledge Distillation Framework for Large-scale Pre-trained Language Model
Currently, the reduction in the parameter scale of large-scale pre-train...
share
research
∙
06/11/2023
Are Intermediate Layers and Labels Really Necessary? A General Language Model Distillation Method
The large scale of pre-trained language models poses a challenge for the...
research
∙
10/05/2022
GLM-130B: An Open Bilingual Pre-trained Model
We introduce GLM-130B, a bilingual (English and Chinese) pre-trained lan...
research
∙
07/14/2022