BERT Knows Punta Cana is not just beautiful, it's gorgeous: Ranking Scalar Adjectives with Contextualised Representations

10/06/2020
by   Aina Garí Soler, et al.
0

Adjectives like pretty, beautiful and gorgeous describe positive properties of the nouns they modify but with different intensity. These differences are important for natural language understanding and reasoning. We propose a novel BERT-based approach to intensity detection for scalar adjectives. We model intensity by vectors directly derived from contextualised representations and show they can successfully rank scalar adjectives. We evaluate our models both intrinsically, on gold standard datasets, and on an Indirect Question Answering task. Our results demonstrate that BERT encodes rich knowledge about the semantics of scalar adjectives, and is able to provide better quality intensity rankings than static embeddings and previous models with access to dedicated resources.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

05/03/2021

Scalar Adjective Identification and Multilingual Ranking

The intensity relationship that holds between scalar adjectives (e.g., n...
04/07/2020

Knowledge Fusion and Semantic Knowledge Ranking for Open Domain Question Answering

Open Domain Question Answering requires systems to retrieve external kno...
08/19/2019

A Study of BERT for Non-Factoid Question-Answering under Passage Length Constraints

We study the use of BERT for non-factoid question-answering, focusing on...
09/05/2019

Semantics-aware BERT for Language Understanding

The latest work on language representations carefully integrates context...
11/24/2020

Picking BERT's Brain: Probing for Linguistic Dependencies in Contextualized Embeddings Using Representational Similarity Analysis

As the name implies, contextualized representations of language are typi...
06/03/2019

Resolving Gendered Ambiguous Pronouns with BERT

Pronoun resolution is part of coreference resolution, the task of pairin...
10/03/2020

Personality Trait Detection Using Bagged SVM over BERT Word Embedding Ensembles

Recently, the automatic prediction of personality traits has received in...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.