Replacing Language Model for Style Transfer

11/14/2022
by   Pengyu Cheng, et al.
1

We introduce replacing language model (RLM), a sequence-to-sequence language modeling framework for text style transfer. Our method autoregressively replaces each token in the original sentence with a text span in the target style. In contrast, the new span is generated via a non-autoregressive masked language model. The RLM generation scheme gathers the flexibility of autoregressive models and the accuracy of non-autoregressive models, which bridges the gap between sentence-level and word-level style transfer methods. To further control the style of generated sentences, we conduct a style-content disentanglement on the hidden representations of RLM. Empirical results on real-world text style transfer tasks demonstrate the effectiveness of RLM compared with other baselines.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/13/2022

Deep Image Style Transfer from Freeform Text

This paper creates a novel method of deep neural style transfer by gener...
research
01/27/2023

Prompt-Based Editing for Text Style Transfer

Prompting approaches have been recently explored in text style transfer,...
research
06/04/2021

NAST: A Non-Autoregressive Generator with Word Alignment for Unsupervised Text Style Transfer

Autoregressive models have been widely used in unsupervised text style t...
research
10/10/2020

Semi-supervised Formality Style Transfer using Language Model Discriminator and Mutual Information Maximization

Formality style transfer is the task of converting informal sentences to...
research
10/19/2019

XL-Editor: Post-editing Sentences with XLNet

While neural sequence generation models achieve initial success for many...
research
12/20/2022

Pay Attention to Your Tone: Introducing a New Dataset for Polite Language Rewrite

We introduce PoliteRewrite – a dataset for polite language rewrite which...
research
08/16/2019

How Sequence-to-Sequence Models Perceive Language Styles?

Style is ubiquitous in our daily language uses, while what is language s...

Please sign up or login with your details

Forgot password? Click here to reset