Neural Machine Translation on Scarce-Resource Condition: A case-study on Persian-English

01/07/2017
by   Mohaddeseh Bastan, et al.
0

Neural Machine Translation (NMT) is a new approach for Machine Translation (MT), and due to its success, it has absorbed the attention of many researchers in the field. In this paper, we study NMT model on Persian-English language pairs, to analyze the model and investigate the appropriateness of the model for scarce-resourced scenarios, the situation that exists for Persian-centered translation systems. We adjust the model for the Persian language and find the best parameters and hyper parameters for two tasks: translation and transliteration. We also apply some preprocessing task on the Persian dataset which yields to increase for about one point in terms of BLEU score. Also, we have modified the loss function to enhance the word alignment of the model. This new loss function yields a total of 1.87 point improvements in terms of BLEU score in the translation quality.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/20/2016

Lexicons and Minimum Risk Training for Neural Machine Translation: NAIST-CMU at WAT2016

This year, the Nara Institute of Science and Technology (NAIST)/Carnegie...
research
02/02/2020

Neural Machine Translation System of Indic Languages – An Attention based Approach

Neural machine translation (NMT) is a recent and effective technique whi...
research
05/02/2022

Jam or Cream First? Modeling Ambiguity in Neural Machine Translation with SCONES

The softmax layer in neural machine translation is designed to model the...
research
10/06/2020

Converting the Point of View of Messages Spoken to Virtual Assistants

Virtual Assistants can be quite literal at times. If the user says "tell...
research
05/05/2018

Exploring Hyper-Parameter Optimization for Neural Machine Translation on GPU Architectures

Neural machine translation (NMT) has been accelerated by deep learning n...
research
10/18/2019

Controlling Utterance Length in NMT-based Word Segmentation with Attention

One of the basic tasks of computational language documentation (CLD) is ...
research
04/23/2018

A Call for Clarity in Reporting BLEU Scores

The field of machine translation is blessed with new challenges resultin...

Please sign up or login with your details

Forgot password? Click here to reset