SChME at SemEval-2020 Task 1: A Model Ensemble for Detecting Lexical Semantic Change

12/02/2020
by   Mauricio Gruppi, et al.
0

This paper describes SChME (Semantic Change Detection with Model Ensemble), a method usedin SemEval-2020 Task 1 on unsupervised detection of lexical semantic change. SChME usesa model ensemble combining signals of distributional models (word embeddings) and wordfrequency models where each model casts a vote indicating the probability that a word sufferedsemantic change according to that feature. More specifically, we combine cosine distance of wordvectors combined with a neighborhood-based metric we named Mapped Neighborhood Distance(MAP), and a word frequency differential metric as input signals to our model. Additionally,we explore alignment-based methods to investigate the importance of the landmarks used in thisprocess. Our results show evidence that the number of landmarks used for alignment has a directimpact on the predictive performance of the model. Moreover, we show that languages that sufferless semantic change tend to benefit from using a large number of landmarks, whereas languageswith more semantic change benefit from a more careful choice of landmark number for alignment.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/06/2020

OP-IMS @ DIACR-Ita: Back to the Roots: SGNS+OP+CD still rocks Semantic Change Detection

We present the results of our participation in the DIACR-Ita shared task...
research
04/30/2020

UiO-UvA at SemEval-2020 Task 1: Contextualised Embeddings for Lexical Semantic Change Detection

We apply contextualised word embeddings to lexical semantic change detec...
research
06/04/2019

Time-Out: Temporal Referencing for Robust Modeling of Lexical Semantic Change

State-of-the-art models of lexical semantic change detection suffer from...
research
11/07/2020

NLP-CIC @ DIACR-Ita: POS and Neighbor Based Distributional Models for Lexical Semantic Change in Diachronic Italian Corpora

We present our systems and findings on unsupervised lexical semantic cha...
research
01/30/2021

Fake it Till You Make it: Self-Supervised Semantic Shifts for Monolingual Word Embedding Tasks

The use of language is subject to variation over time as well as across ...
research
08/07/2020

IMS at SemEval-2020 Task 1: How low can you go? Dimensionality in Lexical Semantic Change Detection

We present the results of our system for SemEval-2020 Task 1 that exploi...
research
08/31/2022

Contextualized language models for semantic change detection: lessons learned

We present a qualitative analysis of the (potentially erroneous) outputs...

Please sign up or login with your details

Forgot password? Click here to reset