On-the-Fly Controlled Text Generation with Experts and Anti-Experts

05/07/2021
by   Alisa Liu, et al.
0

Despite recent advances in natural language generation, it remains challenging to control attributes of generated text. We propose DExperts: Decoding-time Experts, a decoding-time method for controlled text generation which combines a pretrained language model with experts and/or anti-experts in an ensemble of language models. Intuitively, under our ensemble, output tokens only get high probability if they are considered likely by the experts, and unlikely by the anti-experts. We apply DExperts to language detoxification and sentiment-controlled generation, where we outperform existing controllable generation methods on both automatic and human evaluations. Our work highlights the promise of using LMs trained on text with (un)desired attributes for efficient decoding-time controlled language generation.

READ FULL TEXT

page 7

page 14

research
05/22/2023

A Frustratingly Simple Decoding Method for Neural Text Generation

We introduce a frustratingly simple, super efficient and surprisingly ef...
research
07/06/2023

PREADD: Prefix-Adaptive Decoding for Controlled Text Generation

We propose Prefix-Adaptive Decoding (PREADD), a flexible method for cont...
research
10/14/2022

PCFG-based Natural Language Interface Improves Generalization for Controlled Text Generation

Existing work on controlled text generation (CTG) assumes a control inte...
research
12/21/2022

Critic-Guided Decoding for Controlled Text Generation

Steering language generation towards objectives or away from undesired c...
research
05/16/2020

A Text Reassembling Approach to NaturalLanguage Generation

Recent years have seen a number of proposals for performing Natural Lang...
research
03/08/2023

On the Risks of Stealing the Decoding Algorithms of Language Models

A key component of generating text from modern language models (LM) is t...
research
05/31/2023

An Invariant Learning Characterization of Controlled Text Generation

Controlled generation refers to the problem of creating text that contai...

Please sign up or login with your details

Forgot password? Click here to reset