Zero-shot Domain Adaptation for Neural Machine Translation with Retrieved Phrase-level Prompts

09/23/2022
by   Zewei Sun, et al.
0

Domain adaptation is an important challenge for neural machine translation. However, the traditional fine-tuning solution requires multiple extra training and yields a high cost. In this paper, we propose a non-tuning paradigm, resolving domain adaptation with a prompt-based method. Specifically, we construct a bilingual phrase-level database and retrieve relevant pairs from it as a prompt for the input sentences. By utilizing Retrieved Phrase-level Prompts (RePP), we effectively boost the translation quality. Experiments show that our method improves domain-specific machine translation for 6.2 BLEU scores and improves translation constraints for 11.5 additional training.

READ FULL TEXT
research
12/19/2016

Domain specialization: a post-training domain adaptation for Neural Machine Translation

Domain adaptation is a key feature in Machine Translation. It generally ...
research
06/07/2019

Word-based Domain Adaptation for Neural Machine Translation

In this paper, we empirically investigate applying word-level weights to...
research
09/21/2021

Learning Kernel-Smoothed Machine Translation with Retrieved Examples

How to effectively adapt neural machine translation (NMT) models accordi...
research
04/18/2023

Tailoring Domain Adaptation for Machine Translation Quality Estimation

While quality estimation (QE) can play an important role in the translat...
research
10/23/2019

Instance-Based Model Adaptation For Direct Speech Translation

Despite recent technology advancements, the effectiveness of neural appr...
research
12/19/2020

Finding Sparse Structure for Domain Specific Neural Machine Translation

Fine-tuning is a major approach for domain adaptation in Neural Machine ...
research
11/05/2018

Compact Personalized Models for Neural Machine Translation

We propose and compare methods for gradient-based domain adaptation of s...

Please sign up or login with your details

Forgot password? Click here to reset