Simple-QE: Better Automatic Quality Estimation for Text Simplification

12/22/2020
by   Reno Kriz, et al.
0

Text simplification systems generate versions of texts that are easier to understand for a broader audience. The quality of simplified texts is generally estimated using metrics that compare to human references, which can be difficult to obtain. We propose Simple-QE, a BERT-based quality estimation (QE) model adapted from prior summarization QE work, and show that it correlates well with human quality judgments. Simple-QE does not require human references, which makes the model useful in a practical setting where users would need to be informed about the quality of generated simplifications. We also show that we can adapt this approach to accurately predict the complexity of human-written texts.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/02/2019

SumQE: a BERT-based Summary Quality Estimation Model

We propose SumQE, a novel Quality Estimation model for summarization bas...
research
04/15/2022

Evaluating Factuality in Text Simplification

Automated simplification models aim to make input texts more readable. S...
research
06/03/2019

Handling Divergent Reference Texts when Evaluating Table-to-Text Generation

Automatically constructed datasets for generating text from semi-structu...
research
06/07/2023

Intrinsic Dimension Estimation for Robust Detection of AI-Generated Texts

Rapidly increasing quality of AI-generated content makes it difficult to...
research
10/31/2022

50 Ways to Bake a Cookie: Mapping the Landscape of Procedural Texts

The web is full of guidance on a wide variety of tasks, from changing th...
research
08/22/2023

Using ChatGPT as a CAT tool in Easy Language translation

This study sets out to investigate the feasibility of using ChatGPT to t...
research
07/02/2017

Automatic Trimap Generation for Image Matting

Image matting is a longstanding problem in computational photography. Al...

Please sign up or login with your details

Forgot password? Click here to reset