DeepAI AI Chat
Log In Sign Up

Japanese Predicate Conjugation for Neural Machine Translation

05/25/2018
by   Michiki Kurosawa, et al.
0

Neural machine translation (NMT) has a drawback in that can generate only high-frequency words owing to the computational costs of the softmax function in the output layer. In Japanese-English NMT, Japanese predicate conjugation causes an increase in vocabulary size. For example, one verb can have as many as 19 surface varieties. In this research, we focus on predicate conjugation for compressing the vocabulary size in Japanese. The vocabulary list is filled with the various forms of verbs. We propose methods using predicate conjugation information without discarding linguistic information. The proposed methods can generate low-frequency words and deal with unknown words. Two methods were considered to introduce conjugation information: the first considers it as a token (conjugation token) and the second considers it as an embedded vector (conjugation feature). The results using these methods demonstrate that the vocabulary size can be compressed by approximately 86.1 the words not in the training data set. Furthermore, BLEU scores improved by 0.91 points in Japanese-to-English translation, and 0.32 points in English-to-Japanese translation with ASPEC.

READ FULL TEXT

page 1

page 2

page 3

page 4

12/05/2017

Neural Machine Translation by Generating Multiple Linguistic Factors

Factored neural machine translation (FNMT) is founded on the idea of usi...
07/30/2018

Training Neural Machine Translation using Word Embedding-based Loss

In neural machine translation (NMT), the computational cost at the outpu...
07/25/2018

Finding Better Subword Segmentation for Neural Machine Translation

For different language pairs, word-level neural machine translation (NMT...
12/31/2020

VOLT: Improving Vocabularization via Optimal Transport for Machine Translation

It is well accepted that the choice of token vocabulary largely affects ...
09/15/2016

Factored Neural Machine Translation

We present a new approach for neural machine translation (NMT) using the...
01/11/2018

Improved English to Russian Translation by Neural Suffix Prediction

Neural machine translation (NMT) suffers a performance deficiency when a...
10/06/2022

Reinforcement Learning with Large Action Spaces for Neural Machine Translation

Applying Reinforcement learning (RL) following maximum likelihood estima...