Chunk-Based Bi-Scale Decoder for Neural Machine Translation

05/03/2017
by   Hao Zhou, et al.
0

In typical neural machine translation (NMT), the decoder generates a sentence word by word, packing all linguistic granularities in the same time-scale of RNN. In this paper, we propose a new type of decoder for NMT, which splits the decode state into two parts and updates them in two different time-scales. Specifically, we first predict a chunk time-scale state for phrasal modeling, on top of which multiple word time-scale states are generated. In this way, the target sentence is translated hierarchically from chunks to words, with information in different granularities being leveraged. Experiments show that our proposed model significantly improves the translation performance over the state-of-the-art NMT model.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/07/2016

Neural Machine Translation with Reconstruction

Although end-to-end Neural Machine Translation (NMT) has achieved remark...
research
01/18/2019

Modeling Latent Sentence Structure in Neural Machine Translation

Recently it was shown that linguistic structure predicted by a supervise...
research
09/06/2017

Information-Propogation-Enhanced Neural Machine Translation by Relation Model

Even though sequence-to-sequence neural machine translation (NMT) model ...
research
07/10/2020

Learn to Use Future Information in Simultaneous Translation

Simultaneous neural machine translation (briefly, NMT) has attracted muc...
research
08/28/2018

A Tree-based Decoder for Neural Machine Translation

Recent advances in Neural Machine Translation (NMT) show that adding syn...
research
09/14/2017

Global-Context Neural Machine Translation through Target-Side Attentive Residual Connections

Neural sequence-to-sequence models achieve remarkable performance not on...
research
09/26/2019

Large-scale Pretraining for Neural Machine Translation with Tens of Billions of Sentence Pairs

In this paper, we investigate the problem of training neural machine tra...

Please sign up or login with your details

Forgot password? Click here to reset