Low-Level Linguistic Controls for Style Transfer and Content Preservation

11/08/2019
by   Katy Gero, et al.
0

Despite the success of style transfer in image processing, it has seen limited progress in natural language generation. Part of the problem is that content is not as easily decoupled from style in the text domain. Curiously, in the field of stylometry, content does not figure prominently in practical methods of discriminating stylistic elements, such as authorship and genre. Rather, syntax and function words are the most salient features. Drawing on this work, we model style as a suite of low-level linguistic controls, such as frequency of pronouns, prepositions, and subordinate clause constructions. We train a neural encoder-decoder model to reconstruct reference sentences given only content words and the setting of the controls. We perform style transfer by keeping the content words fixed while adjusting the controls to be indicative of another style. In experiments, we show that the model reliably responds to the linguistic controls and perform both automatic and manual evaluations on style transfer. We find we can fool a style classifier 84 the time, and that our model produces highly diverse and stylistically distinctive outputs. This work introduces a formal, extendable model of style that can add control to any neural text generation system.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/15/2018

Structured Content Preservation for Unsupervised Text Style Transfer

Text style transfer aims to modify the style of a sentence while keeping...
research
07/09/2023

DIFF-NST: Diffusion Interleaving For deFormable Neural Style Transfer

Neural Style Transfer (NST) is the field of study applying neural techni...
research
07/09/2017

Controlling Linguistic Style Aspects in Neural Language Generation

Most work on neural natural language generation (NNLG) focus on controll...
research
04/08/2020

Conditional Rap Lyrics Generation with Denoising Autoencoders

We develop a method for automatically synthesizing a rap verse given an ...
research
02/01/2021

GTAE: Graph-Transformer based Auto-Encoders for Linguistic-Constrained Text Style Transfer

Non-parallel text style transfer has attracted increasing research inter...
research
08/12/2021

Syntax Matters! Syntax-Controlled in Text Style Transfer

Existing text style transfer (TST) methods rely on style classifiers to ...
research
08/29/2022

StoryTrans: Non-Parallel Story Author-Style Transfer with Discourse Representations and Content Enhancing

Non-parallel text style transfer is an important task in natural languag...

Please sign up or login with your details

Forgot password? Click here to reset