Spelling Correction as a Foreign Language

05/21/2017
by   Yingbo Zhou, et al.
0

In this paper, we reformulated the spell correction problem as a machine translation task under the encoder-decoder framework. This reformulation enabled us to use a single model for solving the problem that is traditionally formulated as learning a language model and an error model. This model employs multi-layer recurrent neural networks as an encoder and a decoder. We demonstrate the effectiveness of this model using an internal dataset, where the training data is automatically obtained from user logs. The model offers competitive performance as compared to the state of the art methods but does not require any feature engineering nor hand tuning between models.

READ FULL TEXT
research
04/08/2023

Decoder-Only or Encoder-Decoder? Interpreting Language Model as a Regularized Encoder-Decoder

The sequence-to-sequence (seq2seq) task aims at generating the target se...
research
01/26/2018

A Multilayer Convolutional Encoder-Decoder Neural Network for Grammatical Error Correction

We improve automatic correction of grammatical, orthographic, and colloc...
research
03/31/2016

Neural Language Correction with Character-Based Attention

Natural language correction has the potential to help language learners ...
research
06/01/2020

Residual Squeeze-and-Excitation Network for Fast Image Deraining

Image deraining is an important image processing task as rain streaks no...
research
04/28/2019

Neural Machine Translation with Recurrent Highway Networks

Recurrent Neural Networks have lately gained a lot of popularity in lang...
research
05/24/2020

Stronger Baselines for Grammatical Error Correction Using Pretrained Encoder-Decoder Model

Grammatical error correction (GEC) literature has reported on the effect...
research
11/22/2022

PESE: Event Structure Extraction using Pointer Network based Encoder-Decoder Architecture

The task of event extraction (EE) aims to find the events and event-rela...

Please sign up or login with your details

Forgot password? Click here to reset