research
∙
10/12/2022
Foundation Transformers
A big convergence of model architectures across language, vision, speech...
share
research
∙
01/28/2022
Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model
Pretrained general-purpose language models can achieve state-of-the-art ...
research
∙
07/01/2019
Learning Representations from Imperfect Time Series Data via Tensor Rank Regularization
There has been an increased interest in multimodal language processing i...
research
∙
11/23/2018
Words Can Shift: Dynamically Adjusting Word Representations Using Nonverbal Behaviors
Humans convey their intentions through the usage of both verbal and nonv...
research
∙
05/31/2018