A Tree-based Decoder for Neural Machine Translation

08/28/2018
by   Xinyi Wang, et al.
0

Recent advances in Neural Machine Translation (NMT) show that adding syntactic information to NMT systems can improve the quality of their translations. Most existing work utilizes some specific types of linguistically-inspired tree structures, like constituency and dependency parse trees. This is often done via a standard RNN decoder that operates on a linearized target tree structure. However, it is an open question of what specific linguistic formalism, if any, is the best structural representation for NMT. In this paper, we (1) propose an NMT model that can naturally generate the topology of an arbitrary tree structure on the target side, and (2) experiment with various target tree structures. Our experiments show the surprising result that our model delivers the best improvements with balanced binary trees constructed without any linguistic knowledge; this model outperforms standard seq2seq models by up to 2.1 BLEU points, and other methods for incorporating target-side syntax by up to 0.7 BLEU.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/16/2017

Towards String-to-Tree Neural Machine Translation

We present a simple method to incorporate syntactic information about th...
research
05/28/2018

Inducing Grammars with and for Neural Machine Translation

Machine translation systems require semantic knowledge and grammatical u...
research
05/03/2017

Chunk-Based Bi-Scale Decoder for Neural Machine Translation

In typical neural machine translation (NMT), the decoder generates a sen...
research
05/08/2018

Improving Character-level Japanese-Chinese Neural Machine Translation with Radicals as an Additional Input Feature

In recent years, Neural Machine Translation (NMT) has been proven to get...
research
05/08/2019

Syntax-Enhanced Neural Machine Translation with Syntax-Aware Word Representations

Syntax has been demonstrated highly effective in neural machine translat...
research
10/23/2019

Controlling the Output Length of Neural Machine Translation

The recent advances introduced by neural machine translation (NMT) are r...
research
08/30/2019

Latent Part-of-Speech Sequences for Neural Machine Translation

Learning target side syntactic structure has been shown to improve Neura...

Please sign up or login with your details

Forgot password? Click here to reset