research
∙
06/14/2023
Recipes for Sequential Pre-training of Multilingual Encoder and Seq2Seq Models
Pre-trained encoder-only and sequence-to-sequence (seq2seq) models each ...
share
research
∙
10/13/2022
CLASP: Few-Shot Cross-Lingual Data Augmentation for Semantic Parsing
A bottleneck to developing Semantic Parsing (SP) models is the need for ...
research
∙
09/20/2022
LINGUIST: Language Model Instruction Tuning to Generate Annotated Utterances for Intent Classification and Slot Tagging
We present LINGUIST, a method for generating annotated data for Intent C...
research
∙
08/02/2022
AlexaTM 20B: Few-Shot Learning Using a Large-Scale Multilingual Seq2Seq Model
In this work, we demonstrate that multilingual large-scale sequence-to-s...
research
∙
06/15/2022
Alexa Teacher Model: Pretraining and Distilling Multi-Billion-Parameter Encoders for Natural Language Understanding Systems
We present results from a large-scale experiment on pretraining encoders...
research
∙
10/08/2020