research
∙
07/11/2023
Attribute Controlled Dialogue Prompting
Prompt-tuning has become an increasingly popular parameter-efficient met...
share
research
∙
05/08/2023
LABO: Towards Learning Optimal Label Regularization via Bi-level Optimization
Regularization techniques are crucial to improving the generalization pe...
research
∙
12/12/2022
Improving Generalization of Pre-trained Language Models via Stochastic Weight Averaging
Knowledge Distillation (KD) is a commonly used technique for improving t...
research
∙
06/30/2022
Learning Functions on Multiple Sets using Multi-Set Transformers
We propose a general deep architecture for learning functions on multipl...
research
∙
11/09/2021
NATURE: Natural Auxiliary Text Utterances for Realistic Spoken Language Evaluation
Slot-filling and intent detection are the backbone of conversational age...
research
∙
10/15/2021
Kronecker Decomposition for GPT Compression
GPT is an auto-regressive Transformer-based pre-trained language model w...
research
∙
09/21/2021
Knowledge Distillation with Noisy Labels for Natural Language Understanding
Knowledge Distillation (KD) is extensively used to compress and deploy l...
research
∙
09/13/2021
How to Select One Among All? An Extensive Empirical Study Towards the Robustness of Knowledge Distillation in Natural Language Understanding
Knowledge Distillation (KD) is a model compression algorithm that helps ...
research
∙
09/05/2021
End-to-End Self-Debiasing Framework for Robust NLU Training
Existing Natural Language Understanding (NLU) models have been shown to ...
research
∙
07/24/2021
Context-aware Adversarial Training for Name Regularity Bias in Named Entity Recognition
In this work, we examine the ability of NER models to use contextual inf...
research
∙
05/12/2021
MATE-KD: Masked Adversarial TExt, a Companion to Knowledge Distillation
The advent of large pre-trained language models has given rise to rapid ...
research
∙
04/17/2021
Robust Embeddings Via Distributions
Despite recent monumental advances in the field, many Natural Language P...
research
∙
12/31/2020
Towards Zero-Shot Knowledge Distillation for Natural Language Processing
Knowledge Distillation (KD) is a common knowledge transfer algorithm use...
research
∙
10/02/2019
Distilled embedding: non-linear embedding factorization using knowledge distillation
Word-embeddings are a vital component of Natural Language Processing (NL...
research
∙
04/15/2019
Latent Code and Text-based Generative Adversarial Networks for Soft-text Generation
Text generation with generative adversarial networks (GANs) can be divid...
research
∙
04/09/2019