Uralic Language Identification (ULI) 2020 shared task dataset and the Wanca 2017 corpus

by   Tommi Jauhiainen, et al.

This article introduces the Wanca 2017 corpus of texts crawled from the internet from which the sentences in rare Uralic languages for the use of the Uralic Language Identification (ULI) 2020 shared task were collected. We describe the ULI dataset and how it was constructed using the Wanca 2017 corpus and texts in different languages from the Leipzig corpora collection. We also provide baseline language identification experiments conducted using the ULI 2020 dataset.


Language and Dialect Identification of Cuneiform Texts

This article introduces a corpus of cuneiform texts from which the datas...

AGRR-2019: A Corpus for Gapping Resolution in Russian

This paper provides a comprehensive overview of the gapping dataset for ...

Character Entropy in Modern and Historical Texts: Comparison Metrics for an Undeciphered Manuscript

This paper outlines the creation of three corpora for multilingual compa...

The Open corpus of the Veps and Karelian languages: overview and applications

A growing priority in the study of Baltic-Finnic languages of the Republ...

PerPaDa: A Persian Paraphrase Dataset based on Implicit Crowdsourcing Data Collection

In this paper we introduce PerPaDa, a Persian paraphrase dataset that is...

Measuring vagueness and subjectivity in texts: from symbolic to neural VAGO

We present a hybrid approach to the automated measurement of vagueness a...

Towards De-identification of Legal Texts

In many countries, personal information that can be published or shared ...

Please sign up or login with your details

Forgot password? Click here to reset