Evaluation of Chinese-English Machine Translation of Emotion-Loaded Microblog Texts: A Human Annotated Dataset for the Quality Assessment of Emotion Translation

06/20/2023
by   Shenbin Qian, et al.
0

In this paper, we focus on how current Machine Translation (MT) tools perform on the translation of emotion-loaded texts by evaluating outputs from Google Translate according to a framework proposed in this paper. We propose this evaluation framework based on the Multidimensional Quality Metrics (MQM) and perform a detailed error analysis of the MT outputs. From our analysis, we observe that about 50 After further analysis of the errors, we find that emotion carrying words and linguistic phenomena such as polysemous words, negation, abbreviation etc., are common causes for these translation errors.

READ FULL TEXT
research
11/21/2017

Evaluating Machine Translation Performance on Chinese Idioms with a Blacklist Method

Idiom translation is a challenging problem in machine translation becaus...
research
05/24/2023

MuLER: Detailed and Scalable Reference-based Evaluation

We propose a novel methodology (namely, MuLER) that transforms any refer...
research
06/09/2023

Good, but not always Fair: An Evaluation of Gender Bias for three commercial Machine Translation Systems

Machine Translation (MT) continues to make significant strides in qualit...
research
08/14/2023

The Devil is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation Evaluation

Automatic evaluation of machine translation (MT) is a critical tool driv...
research
02/02/2018

Quantitative Fine-Grained Human Evaluation of Machine Translation Systems: a Case Study on English to Croatian

This paper presents a quantitative fine-grained manual evaluation approa...
research
10/16/2019

Linguistic evaluation of German-English Machine Translation using a Test Suite

We present the results of the application of a grammatical test suite fo...
research
10/18/2015

Neural Reranking Improves Subjective Quality of Machine Translation: NAIST at WAT2015

This year, the Nara Institute of Science and Technology (NAIST)'s submis...

Please sign up or login with your details

Forgot password? Click here to reset