Lexically Constrained Neural Machine Translation with Levenshtein Transformer

04/27/2020
by   Raymond Hendy Susanto, et al.
0

This paper proposes a simple and effective algorithm for incorporating lexical constraints in neural machine translation. Previous work either required re-training existing models with the lexical constraints or incorporating them during beam search decoding with significantly higher computational overheads. Leveraging the flexibility and speed of a recently proposed Levenshtein Transformer model (Gu et al., 2019), our method injects terminology constraints at inference time without any impact on decoding speed. Our method does not require any modification to the training procedure and can be easily applied at runtime with custom dictionaries. Experiments on English-German WMT datasets show that our approach improves an unconstrained baseline and previous approaches.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/13/2020

EDITOR: an Edit-Based Transformer with Repositioning for Neural Machine Translation with Soft Lexical Constraints

We introduce an Edit-Based Transformer with Repositioning (EDITOR), whic...
research
08/07/2023

Negative Lexical Constraints in Neural Machine Translation

This paper explores negative lexical constraining in English to Czech ne...
research
06/03/2019

Training Neural Machine Translation To Apply Terminology Constraints

This paper proposes a novel method to inject custom terminology into neu...
research
04/24/2017

Lexically Constrained Decoding for Sequence Generation Using Grid Beam Search

We present Grid Beam Search (GBS), an algorithm which extends beam searc...
research
06/07/2021

Encouraging Neural Machine Translation to Satisfy Terminology Constraints

We present a new approach to encourage neural machine translation to sat...
research
08/13/2019

Neural Machine Translation with Noisy Lexical Constraints

Lexically constrained decoding for machine translation has shown to be b...
research
06/10/2021

Input Augmentation Improves Constrained Beam Search for Neural Machine Translation: NTT at WAT 2021

This paper describes our systems that were submitted to the restricted t...

Please sign up or login with your details

Forgot password? Click here to reset