The Daunting Task of Real-World Textual Style Transfer Auto-Evaluation

10/09/2019
by   Richard Yuanzhe Pang, et al.
0

The difficulty of textual style transfer lies in the lack of parallel corpora. Numerous advances have been proposed for the unsupervised generation. However, significant problems remain with the auto-evaluation of style transfer tasks. Based on the summary of Pang and Gimpel (2018) and Mir et al. (2019), style transfer evaluations rely on three criteria: style accuracy of transferred sentences, content similarity between original and transferred sentences, and fluency of transferred sentences. We elucidate the problematic current state of style transfer research. Given that current tasks do not represent real use cases of style transfer, current auto-evaluation approach is flawed. This discussion aims to bring researchers to think about the future of style transfer and style transfer evaluation research.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/09/2021

A Review of Human Evaluation for Style Transfer

This paper reviews and summarizes human evaluation practices described i...
research
04/27/2021

SE-DAE: Style-Enhanced Denoising Auto-Encoder for Unsupervised Text Style Transfer

Text style transfer aims to change the style of sentences while preservi...
research
12/18/2022

Low-Resource Authorship Style Transfer with In-Context Learning

Authorship style transfer involves altering the style of text to match t...
research
05/05/2020

Exploring Contextual Word-level Style Relevance for Unsupervised Style Transfer

Unsupervised style transfer aims to change the style of an input sentenc...
research
05/26/2017

Style Transfer from Non-Parallel Text by Cross-Alignment

This paper focuses on style transfer on the basis of non-parallel text. ...
research
03/31/2018

Quantitative Evaluation of Style Transfer

Style transfer methods produce a transferred image which is a rendering ...
research
06/01/2021

Language-Driven Image Style Transfer

Despite having promising results, style transfer, which requires prepari...

Please sign up or login with your details

Forgot password? Click here to reset