Faster decoding for subword level Phrase-based SMT between related languages

11/01/2016
by   Anoop Kunchukuttan, et al.
0

A common and effective way to train translation systems between related languages is to consider sub-word level basic units. However, this increases the length of the sentences resulting in increased decoding time. The increase in length is also impacted by the specific choice of data format for representing the sentences as subwords. In a phrase-based SMT framework, we investigate different choices of decoder parameters as well as data format and their impact on decoding time and translation accuracy. We suggest best options for these settings that significantly improve decoding time with little impact on the translation accuracy.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/03/2016

Orthographic Syllable as basic unit for SMT between Related Languages

We explore the use of the orthographic syllable, a variable-length conso...
research
02/23/2017

Utilizing Lexical Similarity between Related, Low-resource Languages for Pivot-based SMT

We investigate pivot-based translation between related languages in a lo...
research
10/13/2016

Fast, Scalable Phrase-Based SMT Decoding

The utilization of statistical machine translation (SMT) has grown enorm...
research
11/20/2017

Fast BTG-Forest-Based Hierarchical Sub-sentential Alignment

In this paper, we propose a novel BTG-forest-based alignment method. Bas...
research
10/20/2016

Learning variable length units for SMT between related languages via Byte Pair Encoding

We explore the use of segments learnt using Byte Pair Encoding (referred...
research
12/20/2019

Analysis of Graph Transformation Systems: Native vs Translation-based Techniques

The paper summarises the contributions in a session at GCM 2019 presenti...
research
01/06/2019

A Comparative Study on Vocabulary Reduction for Phrase Table Smoothing

This work systematically analyzes the smoothing effect of vocabulary red...

Please sign up or login with your details

Forgot password? Click here to reset