research
∙
04/15/2022
CILDA: Contrastive Data Augmentation using Intermediate Layer Knowledge Distillation
Knowledge distillation (KD) is an efficient framework for compressing la...
share
research
∙
09/21/2021
RAIL-KD: RAndom Intermediate Layer Mapping for Knowledge Distillation
Intermediate layer knowledge distillation (KD) can improve the standard ...
research
∙
03/17/2021
Transformer-based ASR Incorporating Time-reduction Layer and Fine-tuning with Self-Knowledge Distillation
End-to-end automatic speech recognition (ASR), unlike conventional ASR, ...
research
∙
03/10/2021
Fine-tuning of Pre-trained End-to-end Speech Recognition with Generative Adversarial Networks
Adversarial training of end-to-end (E2E) ASR systems using generative ad...
research
∙
11/09/2019
Fully Quantizing a Simplified Transformer for End-to-end Speech Recognition
While significant improvements have been made in recent years in terms o...
research
∙
10/02/2019
Distilled embedding: non-linear embedding factorization using knowledge distillation
Word-embeddings are a vital component of Natural Language Processing (NL...
research
∙
04/23/2019
TextKD-GAN: Text Generation using KnowledgeDistillation and Generative Adversarial Networks
Text generation is of particular interest in many NLP applications such ...
research
∙
04/15/2019
Latent Code and Text-based Generative Adversarial Networks for Soft-text Generation
Text generation with generative adversarial networks (GANs) can be divid...
research
∙
04/09/2019
Bilingual-GAN: A Step Towards Parallel Text Generation
Latent space based GAN methods and attention based sequence to sequence ...
research
∙
09/28/2018