A Trie-Structured Bayesian Model for Unsupervised Morphological Segmentation

04/24/2017
by   Murathan Kurfalı, et al.
0

In this paper, we introduce a trie-structured Bayesian model for unsupervised morphological segmentation. We adopt prior information from different sources in the model. We use neural word embeddings to discover words that are morphologically derived from each other and thereby that are semantically similar. We use letter successor variety counts obtained from tries that are built by neural word embeddings. Our results show that using different information sources such as neural word embeddings and letter successor variety as prior information improves morphological segmentation in a Bayesian model. Our model outperforms other unsupervised morphological segmentation models on Turkish and gives promising results on English and German for scarce resources.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/15/2017

Unsupervised Morphological Expansion of Small Datasets for Improving Word Embeddings

We present a language independent, unsupervised method for building word...
research
08/03/2016

Morphological Priors for Probabilistic Neural Word Embeddings

Word embeddings allow natural language processing systems to share stati...
research
07/04/2019

Morphological Word Embeddings

Linguistic similarity is multi-faceted. For instance, two words may be s...
research
04/28/2017

Neural Word Segmentation with Rich Pretraining

Neural word segmentation research has benefited from large-scale raw tex...
research
03/08/2015

An Unsupervised Method for Uncovering Morphological Chains

Most state-of-the-art systems today produce morphological analysis based...
research
09/05/2018

Free as in Free Word Order: An Energy Based Model for Word Segmentation and Morphological Tagging in Sanskrit

The configurational information in sentences of a free word order langua...
research
10/14/2021

Unsupervised Data-Driven Nuclei Segmentation For Histology Images

An unsupervised data-driven nuclei segmentation method for histology ima...

Please sign up or login with your details

Forgot password? Click here to reset