The Effect of Context on Metaphor Paraphrase Aptness Judgments

09/04/2018
by   Yuri Bizzoni, et al.
0

We conduct two experiments to study the effect of context on metaphor paraphrase aptness judgments. The first is an AMT crowd source task in which speakers rank metaphor paraphrase candidate sentence pairs in short document contexts for paraphrase aptness. In the second we train a composite DNN to predict these human judgments, first in binary classifier mode, and then as gradient ratings. We found that for both mean human judgments and our DNN's predictions, adding document context compresses the aptness scores towards the center of the scale, raising low out of context ratings and decreasing high out of context scores. We offer a provisional explanation for this compression effect.

READ FULL TEXT
research
04/02/2020

How Furiously Can Colourless Green Ideas Sleep? Sentence Acceptability in Context

We study the influence of context on sentence acceptability. First we co...
research
04/21/2021

On User Interfaces for Large-Scale Document-Level Human Evaluation of Machine Translation Outputs

Recent studies emphasize the need of document context in human evaluatio...
research
09/03/2019

Better Rewards Yield Better Summaries: Learning to Summarise Without References

Reinforcement Learning (RL) based document summarisation systems yield s...
research
11/03/2020

Results of a Single Blind Literary Taste Test with Short Anonymized Novel Fragments

It is an open question to what extent perceptions of literary quality ar...
research
10/09/2021

Label quality in AffectNet: results of crowd-based re-annotation

AffectNet is one of the most popular resources for facial expression rec...
research
03/13/2017

Users prefer Guetzli JPEG over same-sized libjpeg

We report on pairwise comparisons by human raters of JPEG images from li...
research
01/07/2020

Listwise Learning to Rank by Exploring Unique Ratings

In this paper, we propose new listwise learning-to-rank models that miti...

Please sign up or login with your details

Forgot password? Click here to reset