Type-Driven Multi-Turn Corrections for Grammatical Error Correction

03/17/2022
by   Shaopeng Lai, et al.
0

Grammatical Error Correction (GEC) aims to automatically detect and correct grammatical errors. In this aspect, dominant models are trained by one-iteration learning while performing multiple iterations of corrections during inference. Previous studies mainly focus on the data augmentation approach to combat the exposure bias, which suffers from two drawbacks. First, they simply mix additionally-constructed training instances and original ones to train models, which fails to help models be explicitly aware of the procedure of gradual corrections. Second, they ignore the interdependence between different types of corrections. In this paper, we propose a Type-Driven Multi-Turn Corrections approach for GEC. Using this approach, from each training instance, we additionally construct multiple training instances, each of which involves the correction of a specific type of errors. Then, we use these additionally-constructed training instances and the original one to train the model in turn. Experimental results and in-depth analysis show that our approach significantly benefits the model training. Particularly, our enhanced model achieves state-of-the-art single-model performance on English GEC benchmarks. We release our code at Github.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/16/2021

Comparison of Grammatical Error Correction Using Back-Translation Models

Grammatical error correction (GEC) suffers from a lack of sufficient par...
research
07/03/2018

Reaching Human-level Performance in Automatic Grammatical Error Correction: An Empirical Study

Neural sequence-to-sequence (seq2seq) approaches have proven to be succe...
research
06/30/2023

Progressive Multi-task Learning Framework for Chinese Text Error Correction

Chinese Text Error Correction (CTEC) aims to detect and correct errors i...
research
11/01/2021

VSEC: Transformer-based Model for Vietnamese Spelling Correction

Spelling error correction is one of topics which have a long history in ...
research
11/01/2018

Spelling Error Correction Using a Nested RNN Model and Pseudo Training Data

We propose a nested recurrent neural network (nested RNN) model for Engl...
research
06/06/2021

Do Grammatical Error Correction Models Realize Grammatical Generalization?

There has been an increased interest in data generation approaches to gr...
research
03/13/2020

Investigating Error Injection to Enhance the Effectiveness of Mobile Text Entry Studies of Error Behaviour

During lab studies of text entry methods it is typical to observer very ...

Please sign up or login with your details

Forgot password? Click here to reset