Enhancing Context Modeling with a Query-Guided Capsule Network for Document-level Translation

09/02/2019
by   Zhengxin Yang, et al.
0

Context modeling is essential to generate coherent and consistent translation for Document-level Neural Machine Translations. The widely used method for document-level translation usually compresses the context information into a representation via hierarchical attention networks. However, this method neither considers the relationship between context words nor distinguishes the roles of context words. To address this problem, we propose a query-guided capsule networks to cluster context information into different perspectives from which the target translation may concern. Experiment results show that our method can significantly outperform strong baselines on multiple data sets of different domains.

READ FULL TEXT
research
10/31/2019

Document-level Neural Machine Translation with Inter-Sentence Attention

Standard neural machine translation (NMT) is on the assumption of docume...
research
09/16/2020

Document-level Neural Machine Translation with Document Embeddings

Standard neural machine translation (NMT) is on the assumption of docume...
research
01/17/2023

HanoiT: Enhancing Context-aware Translation via Selective Context

Context-aware neural machine translation aims to use the document-level ...
research
10/09/2020

Dynamic Context Selection for Document-level Neural Machine Translation via Reinforcement Learning

Document-level neural machine translation has yielded attractive improve...
research
04/30/2020

Capsule-Transformer for Neural Machine Translation

Transformer hugely benefits from its key design of the multi-head self-a...
research
10/16/2022

Modeling Context With Linear Attention for Scalable Document-Level Translation

Document-level machine translation leverages inter-sentence dependencies...
research
02/16/2023

Document Flattening: Beyond Concatenating Context for Document-Level Neural Machine Translation

Existing work in document-level neural machine translation commonly conc...

Please sign up or login with your details

Forgot password? Click here to reset