AMR quality rating with a lightweight CNN

05/25/2020
by   Juri Opitz, et al.
0

Structured semantic sentence representations such as Abstract Meaning Representations (AMRs) are potentially useful in a variety of natural language processing tasks. However, the quality of automatic parses can vary greatly and jeopardizes their usefulness. Therefore, we require systems that can accurately rate AMR quality in the absence of costly gold data. To achieve this, we transfer the AMR graph to the domain of images. This allows us to create a simple convolutional neural network (CNN) that imitates a human rater. In our experiments, we show that the method can rate the quality of AMR graphs more accurately than a strong baseline, with respect to several dimensions of interest. Furthermore, the method proves to be more efficient as it reduces the incurred energy consumption.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/20/2018

SufiSent - Universal Sentence Representations Using Suffix Encodings

Computing universal distributed representations of sentences is a fundam...
research
08/05/2017

Referenceless Quality Estimation for Natural Language Generation

Traditional automatic evaluation measures for natural language generatio...
research
02/23/2021

A Novel Deep Learning Method for Textual Sentiment Analysis

Sentiment analysis is known as one of the most crucial tasks in the fiel...
research
04/17/2019

Automatic Accuracy Prediction for AMR Parsing

Abstract Meaning Representation (AMR) represents sentences as directed, ...
research
04/25/2019

Neural Text Generation from Rich Semantic Representations

We propose neural models to generate high-quality text from structured r...
research
08/28/2018

Disfluency Detection using Auto-Correlational Neural Networks

In recent years, the natural language processing community has moved awa...
research
05/16/2019

TraceWalk: Semantic-based Process Graph Embedding for Consistency Checking

Process consistency checking (PCC), an interdiscipline of natural langua...

Please sign up or login with your details

Forgot password? Click here to reset