SE-DAE: Style-Enhanced Denoising Auto-Encoder for Unsupervised Text Style Transfer

by   Jicheng Li, et al.

Text style transfer aims to change the style of sentences while preserving the semantic meanings. Due to the lack of parallel data, the Denoising Auto-Encoder (DAE) is widely used in this task to model distributions of different sentence styles. However, because of the conflict between the target of the conventional denoising procedure and the target of style transfer task, the vanilla DAE can not produce satisfying enough results. To improve the transferability of the model, most of the existing works combine DAE with various complicated unsupervised networks, which makes the whole system become over-complex. In this work, we design a novel DAE model named Style-Enhanced DAE (SE-DAE), which is specifically designed for the text style transfer task. Compared with previous complicated style-transfer models, our model do not consist of any complicated unsupervised networks, but only relies on the high-quality pseudo-parallel data generated by a novel data refinement mechanism. Moreover, to alleviate the conflict between the targets of the conventional denoising procedure and the style transfer task, we propose another novel style denoising mechanism, which is more compatible with the target of the style transfer task. We validate the effectiveness of our model on two style benchmark datasets. Both automatic evaluation and human evaluation show that our proposed model is highly competitive compared with previous strong the state of the art (SOTA) approaches and greatly outperforms the vanilla DAE.


The Daunting Task of Real-World Textual Style Transfer Auto-Evaluation

The difficulty of textual style transfer lies in the lack of parallel co...

Style Transfer as Unsupervised Machine Translation

Language style transferring rephrases text with specific stylistic attri...

Reinforcement Learning Based Text Style Transfer without Parallel Training Corpus

Text style transfer rephrases a text from a source style (e.g., informal...

Transductive Learning for Unsupervised Text Style Transfer

Unsupervised style transfer models are mainly based on an inductive lear...

StoryTrans: Non-Parallel Story Author-Style Transfer with Discourse Representations and Content Enhancing

Non-parallel text style transfer is an important task in natural languag...

StyleBank: An Explicit Representation for Neural Image Style Transfer

We propose StyleBank, which is composed of multiple convolution filter b...

DGST: a Dual-Generator Network for Text Style Transfer

We propose DGST, a novel and simple Dual-Generator network architecture ...

Please sign up or login with your details

Forgot password? Click here to reset