LemMED: Fast and Effective Neural Morphological Analysis with Short Context Windows

by   Aibek Makazhanov, et al.

We present LemMED, a character-level encoder-decoder for contextual morphological analysis (combined lemmatization and tagging). LemMED extends and is named after two other attention-based models, namely Lematus, a contextual lemmatizer, and MED, a morphological (re)inflection model. Our approach does not require training separate lemmatization and tagging models, nor does it need additional resources and tools, such as morphological dictionaries or transducers. Moreover, LemMED relies solely on character-level representations and on local context. Although the model can, in principle, account for global context on sentence level, our experiments show that using just a single word of context around each target word is not only more computationally feasible, but yields better results as well. We evaluate LemMED in the framework of the SIMGMORPHON-2019 shared task on combined lemmatization and tagging. In terms of average performance LemMED ranks 5th among 13 systems and is bested only by the submissions that use contextualized embeddings.



There are no comments yet.


page 1

page 2

page 3

page 4


Rich Character-Level Information for Korean Morphological Analysis and Part-of-Speech Tagging

Due to the fact that Korean is a highly agglutinative, character-rich la...

Neural Morphological Tagging for Estonian

We develop neural morphological tagging and disambiguation models for Es...

Morphosyntactic Tagging with a Meta-BiLSTM Model over Context Sensitive Token Encodings

The rise of neural networks, and particularly recurrent neural networks,...

Larger-Context Tagging: When and Why Does It Work?

The development of neural networks and pretraining techniques has spawne...

Improving Lemmatization of Non-Standard Languages with Joint Learning

Lemmatization of standard languages is concerned with (i) abstracting ov...

Automated Word Stress Detection in Russian

In this study we address the problem of automated word stress detection ...

Free as in Free Word Order: An Energy Based Model for Word Segmentation and Morphological Tagging in Sanskrit

The configurational information in sentences of a free word order langua...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.