research
∙
05/18/2023
Ahead-of-Time P-Tuning
In this paper, we propose Ahead-of-Time (AoT) P-Tuning, a novel paramete...
share
research
∙
05/18/2023
Democratized Diffusion Language Model
Despite the potential benefits of Diffusion Models for NLP applications,...
research
∙
11/22/2022
Linear Interpolation In Parameter Space is Good Enough for Fine-Tuned Language Models
The simplest way to obtain continuous interpolation between two points i...
research
∙
05/15/2022
Classifiers are Better Experts for Controllable Text Generation
This paper proposes a simple method for controllable text generation bas...
research
∙
04/07/2022
PALBERT: Teaching ALBERT to Ponder
Currently, pre-trained models can be considered the default choice for a...
research
∙
02/23/2022
FastRPB: a Scalable Relative Positional Encoding for Long Sequence Tasks
Transformers achieve remarkable performance in various domains, includin...
research
∙
01/11/2021
Implicit Unlikelihood Training: Improving Neural Text Generation with Reinforcement Learning
Likelihood training and maximization-based decoding result in dull and r...
research
∙
10/14/2020
Weight Squeezing: Reparameterization for Compression and Fast Inference
In this work, we present a novel approach for simultaneous knowledge tra...
research
∙
01/23/2019