Adapting Sequence Models for Sentence Correction

07/27/2017
by   Allen Schmaltz, et al.
0

In a controlled experiment of sequence-to-sequence approaches for the task of sentence correction, we find that character-based models are generally more effective than word-based models and models that encode subword information via convolutions, and that modeling the output data as a series of diffs improves effectiveness over standard approaches. Our strongest sequence-to-sequence model improves over our strongest phrase-based statistical machine translation model, with access to the same data, by 6 M2 (0.5 GLEU) points. Additionally, in the data environment of the standard CoNLL-2014 setup, we demonstrate that modeling (and tuning against) diffs yields similar or better M2 scores with simpler models and/or significantly less data than previous sequence-to-sequence approaches.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/21/2018

Attention-based Encoder-Decoder Networks for Spelling and Grammatical Error Correction

Automatic spelling and grammatical correction systems are one of the mos...
research
10/03/2021

Music Playlist Title Generation: A Machine-Translation Approach

We propose a machine-translation approach to automatically generate a pl...
research
05/23/2019

Copy this Sentence

Attention is an operation that selects some largest element from some se...
research
12/06/2018

Context is Key: New Approaches to Neural Coherence Modeling

We formulate coherence modeling as a regression task and propose two nov...
research
11/06/2022

Deliberation Networks and How to Train Them

Deliberation networks are a family of sequence-to-sequence models, which...
research
07/01/2021

Modeling Target-side Inflection in Placeholder Translation

Placeholder translation systems enable the users to specify how a specif...
research
02/21/2019

Lingvo: a Modular and Scalable Framework for Sequence-to-Sequence Modeling

Lingvo is a Tensorflow framework offering a complete solution for collab...

Please sign up or login with your details

Forgot password? Click here to reset