DeepAI AI Chat
Log In Sign Up

Morphological Tagging and Lemmatization of Albanian: A Manually Annotated Corpus and Neural Models

by   Nelda Kote, et al.

In this paper, we present the first publicly available part-of-speech and morphologically tagged corpus for the Albanian language, as well as a neural morphological tagger and lemmatizer trained on it. There is currently a lack of available NLP resources for Albanian, and its complex grammar and morphology present challenges to their development. We have created an Albanian part-of-speech corpus based on the Universal Dependencies schema for morphological annotation, containing about 118,000 tokens of naturally occuring text collected from different text sources, with an addition of 67,000 tokens of artificially created simple sentences used only in training. On this corpus, we subsequently train and evaluate segmentation, morphological tagging and lemmatization models, using the Turku Neural Parser Pipeline. On the held-out evaluation set, the model achieves 92.74 85.31 annotated corpus, as well as the trained models are available under an open license.


page 1

page 2

page 3

page 4


UniMorph 2.0: Universal Morphology

The Universal Morphology UniMorph project is a collaborative effort to i...

Feature-Rich Part-of-speech Tagging for Morphologically Complex Languages: Application to Bulgarian

We present experiments with part-of-speech tagging for Bulgarian, a Slav...

User-Generated Text Corpus for Evaluating Japanese Morphological Analysis and Lexical Normalization

Morphological analysis (MA) and lexical normalization (LN) are both impo...

Lisan: Yemeni, Iraqi, Libyan, and Sudanese Arabic Dialect Copora with Morphological Annotations

This article presents morphologically-annotated Yemeni, Sudanese, Iraqi,...

FST Morphological Analyser and Generator for Mapudüngun

Following the Mapuche grammar by Smeets, this article describes the main...

CKMorph: A Comprehensive Morphological Analyzer for Central Kurdish

A morphological analyzer, which is a significant component of many natur...

HORAE: an annotated dataset of books of hours

We introduce in this paper a new dataset of annotated pages from books o...