Reformulating Unsupervised Style Transfer as Paraphrase Generation

by   Kalpesh Krishna, et al.

Modern NLP defines the task of style transfer as modifying the style of a given sentence without appreciably changing its semantics, which implies that the outputs of style transfer systems should be paraphrases of their inputs. However, many existing systems purportedly designed for style transfer inherently warp the input's meaning through attribute transfer, which changes semantic properties such as sentiment. In this paper, we reformulate unsupervised style transfer as a paraphrase generation problem, and present a simple methodology based on fine-tuning pretrained language models on automatically generated paraphrase data. Despite its simplicity, our method significantly outperforms state-of-the-art style transfer systems on both human and automatic evaluations. We also survey 23 style transfer papers and discover that existing automatic metrics can be easily gamed and propose fixed variants. Finally, we pivot to a more real-world style transfer setting by collecting a large dataset of 15M sentences in 11 diverse styles, which we use for an in-depth analysis of our system.


page 7

page 18


Style Transfer Through Back-Translation

Style transfer is the task of rephrasing the text to contain specific st...

Automatic Content-Aware Color and Tone Stylization

We introduce a new technique that automatically generates diverse, visua...

Few-shot Controllable Style Transfer for Low-Resource Settings: A Study in Indian Languages

Style transfer is the task of rewriting an input sentence into a target ...

Text Detoxification using Large Pre-trained Neural Models

We present two novel unsupervised methods for eliminating toxicity in te...

Formality Style Transfer with Hybrid Textual Annotations

Formality style transformation is the task of modifying the formality of...

LEWIS: Levenshtein Editing for Unsupervised Text Style Transfer

Many types of text style transfer can be achieved with only small, preci...

How Sequence-to-Sequence Models Perceive Language Styles?

Style is ubiquitous in our daily language uses, while what is language s...