research
∙
06/11/2023
AraMUS: Pushing the Limits of Data and Model Scale for Arabic Natural Language Processing
Developing monolingual large Pre-trained Language Models (PLMs) is shown...
share
research
∙
04/15/2022
CILDA: Contrastive Data Augmentation using Intermediate Layer Knowledge Distillation
Knowledge distillation (KD) is an efficient framework for compressing la...
research
∙
11/09/2021
NATURE: Natural Auxiliary Text Utterances for Realistic Spoken Language Evaluation
Slot-filling and intent detection are the backbone of conversational age...
research
∙
09/21/2021
RAIL-KD: RAndom Intermediate Layer Mapping for Knowledge Distillation
Intermediate layer knowledge distillation (KD) can improve the standard ...
research
∙
09/21/2021
Knowledge Distillation with Noisy Labels for Natural Language Understanding
Knowledge Distillation (KD) is extensively used to compress and deploy l...
research
∙
09/05/2021
End-to-End Self-Debiasing Framework for Robust NLU Training
Existing Natural Language Understanding (NLU) models have been shown to ...
research
∙
07/24/2021
Context-aware Adversarial Training for Name Regularity Bias in Named Entity Recognition
In this work, we examine the ability of NER models to use contextual inf...
research
∙
12/31/2020
Towards Zero-Shot Knowledge Distillation for Natural Language Processing
Knowledge Distillation (KD) is a common knowledge transfer algorithm use...
research
∙
06/09/2018