Evaluation of Morphological Embeddings for English and Russian Languages

03/11/2021
by   Vitaly Romanov, et al.
0

This paper evaluates morphology-based embeddings for English and Russian languages. Despite the interest and introduction of several morphology-based word embedding models in the past and acclaimed performance improvements on word similarity and language modeling tasks, in our experiments, we did not observe any stable preference over two of our baseline models - SkipGram and FastText. The performance exhibited by morphological embeddings is the average of the two baselines mentioned above.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/11/2021

Evaluation of Morphological Embeddings for the Russian Language

A number of morphology-based word embedding models were introduced in re...
research
02/25/2022

Morphology Without Borders: Clause-Level Morphological Annotation

Morphological tasks use large multi-lingual datasets that organize words...
research
09/06/2019

To lemmatize or not to lemmatize: how word normalisation affects ELMo performance in word sense disambiguation

We critically evaluate the widespread assumption that deep learning NLP ...
research
03/31/2019

SART - Similarity, Analogies, and Relatedness for Tatar Language: New Benchmark Datasets for Word Embeddings Evaluation

There is a huge imbalance between languages currently spoken and corresp...
research
02/01/2023

On the Role of Morphological Information for Contextual Lemmatization

Lemmatization is a Natural Language Processing (NLP) task which consists...
research
12/11/2020

Morphology Matters: A Multilingual Language Modeling Analysis

Prior studies in multilingual language modeling (e.g., Cotterell et al.,...
research
01/10/2017

Implicitly Incorporating Morphological Information into Word Embedding

In this paper, we propose three novel models to enhance word embedding b...

Please sign up or login with your details

Forgot password? Click here to reset