Neural versus Phrase-Based Machine Translation Quality: a Case Study

08/16/2016
by   Luisa Bentivogli, et al.
0

Within the field of Statistical Machine Translation (SMT), the neural approach (NMT) has recently emerged as the first technology able to challenge the long-standing dominance of phrase-based approaches (PBMT). In particular, at the IWSLT 2015 evaluation campaign, NMT outperformed well established state-of-the-art PBMT systems on English-German, a language pair known to be particularly hard because of morphology and syntactic differences. To understand in what respects NMT provides better translation quality than PBMT, we perform a detailed analysis of neural versus phrase-based SMT outputs, leveraging high quality post-edits performed by professional translators on the IWSLT data. For the first time, our analysis provides useful insights on what linguistic phenomena are best modeled by neural models -- such as the reordering of verbs -- while pointing out other aspects that remain to be improved.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/01/2017

Improving Neural Machine Translation through Phrase-based Forced Decoding

Compared to traditional statistical machine translation (SMT), neural ma...
research
02/27/2017

A case study on English-Malayalam Machine Translation

In this paper we present our work on a case study on Statistical Machine...
research
02/03/2017

Predicting Target Language CCG Supertags Improves Neural Machine Translation

Neural machine translation (NMT) models are able to partially learn synt...
research
04/24/2017

A Challenge Set Approach to Evaluating Machine Translation

Neural machine translation represents an exciting leap forward in transl...
research
02/17/2015

A Survey of Word Reordering in Statistical Machine Translation: Computational Models and Language Phenomena

Word reordering is one of the most difficult aspects of statistical mach...
research
06/02/2021

Cascade versus Direct Speech Translation: Do the Differences Still Make a Difference?

Five years after the first published proofs of concept, direct approache...
research
10/13/2020

Fine-grained linguistic evaluation for state-of-the-art Machine Translation

This paper describes a test suite submission providing detailed statisti...

Please sign up or login with your details

Forgot password? Click here to reset