Quality Estimation Using Round-trip Translation with Sentence Embeddings

10/31/2021
by   Nathan Crone, et al.
0

Estimating the quality of machine translation systems has been an ongoing challenge for researchers in this field. Many previous attempts at using round-trip translation as a measure of quality have failed, and there is much disagreement as to whether it can be a viable method of quality estimation. In this paper, we revisit round-trip translation, proposing a system which aims to solve the previous pitfalls found with the approach. Our method makes use of recent advances in language representation learning to more accurately gauge the similarity between the original and round-trip translated sentences. Experiments show that while our approach does not reach the performance of current state of the art methods, it may still be an effective approach for some language pairs.

READ FULL TEXT
research
04/29/2020

Revisiting Round-Trip Translation for Quality Estimation

Quality estimation (QE) is the task of automatically evaluating the qual...
research
12/03/2020

SemMT: A Semantic-based Testing Approach for Machine Translation Systems

Machine translation has wide applications in daily life. In mission-crit...
research
09/15/2022

Rethinking Round-trip Translation for Automatic Machine Translation Evaluation

A parallel corpus is generally required to automatically evaluate the tr...
research
09/04/2021

Pushing Paraphrase Away from Original Sentence: A Multi-Round Paraphrase Generation Approach

In recent years, neural paraphrase generation based on Seq2Seq has achie...
research
02/08/2021

Quality Estimation without Human-labeled Data

Quality estimation aims to measure the quality of translated content wit...
research
09/08/2021

Ensemble Fine-tuned mBERT for Translation Quality Estimation

Quality Estimation (QE) is an important component of the machine transla...
research
03/06/2020

A flow disturbance estimation and rejection strategy of multirotors with round trip trajectories

This paper presents a round trip strategy of multirotors with unknown fl...

Please sign up or login with your details

Forgot password? Click here to reset