Annotation and Classification of Sentence-level Revision Improvement

09/03/2019
by   Tazin Afrin, et al.
0

Studies of writing revisions rarely focus on revision quality. To address this issue, we introduce a corpus of between-draft revisions of student argumentative essays, annotated as to whether each revision improves essay quality. We demonstrate a potential usage of our annotations by developing a machine learning model to predict revision improvement. With the goal of expanding training data, we also extract revisions from a dataset edited by expert proofreaders. Our results indicate that blending expert and non-expert revisions increases model performance, with expert data particularly important for predicting low-quality revisions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/27/2021

Supersense and Sensibility: Proxy Tasks for Semantic Annotation of Prepositions

Prepositional supersense annotation is time-consuming and requires exper...
research
05/19/2019

Predicting Annotation Difficulty to Improve Task Routing and Model Performance for Biomedical Information Extraction

Modern NLP systems require high-quality annotated data. In specialized d...
research
05/27/2021

Investigating label suggestions for opinion mining in German Covid-19 social media

This work investigates the use of interactively updated label suggestion...
research
05/01/2023

Logion: Machine Learning for Greek Philology

This paper presents machine-learning methods to address various problems...
research
06/06/2019

Analysis of Automatic Annotation Suggestions for Hard Discourse-Level Tasks in Expert Domains

Many complex discourse-level tasks can aid domain experts in their work ...
research
03/22/2019

Expert-Augmented Machine Learning

Machine Learning is proving invaluable across disciplines. However, its ...
research
08/11/2022

Predicting Tornadoes days ahead with Machine Learning

Developing methods to predict disastrous natural phenomena is more impor...

Please sign up or login with your details

Forgot password? Click here to reset