ParaGuide: Guided Diffusion Paraphrasers for Plug-and-Play Textual Style Transfer

08/29/2023
by   Zachary Horvitz, et al.
0

Textual style transfer is the task of transforming stylistic properties of text while preserving meaning. Target "styles" can be defined in numerous ways, ranging from single attributes (e.g, formality) to authorship (e.g, Shakespeare). Previous unsupervised style-transfer approaches generally rely on significant amounts of labeled data for only a fixed set of styles or require large language models. In contrast, we introduce a novel diffusion-based framework for general-purpose style transfer that can be flexibly adapted to arbitrary target styles at inference time. Our parameter-efficient approach, ParaGuide, leverages paraphrase-conditioned diffusion models alongside gradient-based guidance from both off-the-shelf classifiers and strong existing style embedders to transform the style of text while preserving semantic information. We validate the method on the Enron Email Corpus, with both human and automatic evaluations, and find that it outperforms strong baselines on formality, sentiment, and even authorship style transfer.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/12/2020

Reformulating Unsupervised Style Transfer as Paraphrase Generation

Modern NLP defines the task of style transfer as modifying the style of ...
research
11/23/2022

Inversion-Based Style Transfer with Diffusion Models

The artistic style within a painting is the means of expression, which i...
research
10/08/2020

TextSETTR: Label-Free Text Style Extraction and Tunable Targeted Restyling

We present a novel approach to the problem of text style transfer. Unlik...
research
09/10/2021

Style Pooling: Automatic Text Style Obfuscation for Improved Classification Fairness

Text style can reveal sensitive attributes of the author (e.g. race or a...
research
12/20/2022

SimpleStyle: An Adaptable Style Transfer Approach

Attribute-controlled text rewriting, also known as text style-transfer, ...
research
06/03/2019

Massive Styles Transfer with Limited Labeled Data

Language style transfer has attracted more and more attention in the pas...
research
05/23/2022

Prompt-and-Rerank: A Method for Zero-Shot and Few-Shot Arbitrary Textual Style Transfer with Small Language Models

We propose a method for arbitrary textual style transfer (TST)–the task ...

Please sign up or login with your details

Forgot password? Click here to reset