Improving both domain robustness and domain adaptability in machine translation

12/15/2021
by   Wen Lai, et al.
4

We address two problems of domain adaptation in neural machine translation. First, we want to reach domain robustness, i.e., good quality of both domains from the training data, and domains unseen in the training data. Second, we want our systems to be adaptive, i.e., making it possible to finetune systems with just hundreds of in-domain parallel sentences. In this paper, we introduce a novel combination of two previous approaches, word adaptive modelling, which addresses domain robustness, and meta-learning, which addresses domain adaptability, and we present empirical results showing that our new combination improves both of these properties.

READ FULL TEXT
research
03/03/2021

Meta-Curriculum Learning for Domain Adaptation in Neural Machine Translation

Meta-learning has been sufficiently validated to be beneficial for low-r...
research
03/05/2020

Distill, Adapt, Distill: Training Small, In-Domain Models for Neural Machine Translation

We explore best practices for training small, memory efficient machine t...
research
10/18/2022

Using Language to Extend to Unseen Domains

It is expensive to collect training data for every possible domain that ...
research
10/21/2022

m^4Adapter: Multilingual Multi-Domain Adaptation for Machine Translation with a Meta-Adapter

Multilingual neural machine translation models (MNMT) yield state-of-the...
research
09/06/2023

Epi-Curriculum: Episodic Curriculum Learning for Low-Resource Domain Adaptation in Neural Machine Translation

Neural Machine Translation (NMT) models have become successful, but thei...
research
04/30/2020

Addressing Zero-Resource Domains Using Document-Level Context in Neural Machine Translation

Achieving satisfying performance in machine translation on domains for w...
research
10/18/2020

Meta-Learning for Low-Resource Unsupervised Neural MachineTranslation

Unsupervised machine translation, which utilizes unpaired monolingual co...

Please sign up or login with your details

Forgot password? Click here to reset