research
∙
01/24/2022
Text and Code Embeddings by Contrastive Pre-Training
Text embeddings are useful features in many applications such as semanti...
share
research
∙
07/07/2021
Evaluating Large Language Models Trained on Code
We introduce Codex, a GPT language model fine-tuned on publicly availabl...
research
∙
10/20/2020
Local Knowledge Powered Conversational Agents
State-of-the-art conversational agents have advanced significantly in co...
research
∙
10/12/2020
BioMegatron: Larger Biomedical Domain Language Model
There has been an influx of biomedical domain-specific language models, ...
research
∙
10/02/2020
MEGATRON-CNTRL: Controllable Story Generation with External Knowledge Using Large-Scale Language Models
Existing pre-trained large language models have shown unparalleled gener...
research
∙
05/13/2020
Large Scale Multi-Actor Generative Dialog Modeling
Non-goal oriented dialog agents (i.e. chatbots) aim to produce varying a...
research
∙
02/22/2020
Training Question Answering Models From Synthetic Data
Question and answer generation is a data augmentation method that aims t...
research
∙
12/10/2019
Zero-shot Text Classification With Generative Language Models
This work investigates the use of natural language to enable zero-shot m...
research
∙
09/17/2019
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism
Recent work in unsupervised language modeling demonstrates that training...
research
∙
09/17/2019
Megatron-LM: Training Multi-Billion Parameter Language Models Using GPU Model Parallelism
Recent work in unsupervised language modeling demonstrates that training...
research
∙
12/04/2018
Practical Text Classification With Large Pre-Trained Language Models
Multi-emotion sentiment classification is a natural language processing ...
research
∙
08/03/2018