CBAS: context based arabic stemmer

10/28/2015
by   Mahmoud El-Defrawy, et al.
0

Arabic morphology encapsulates many valuable features such as word root. Arabic roots are being utilized for many tasks; the process of extracting a word root is referred to as stemming. Stemming is an essential part of most Natural Language Processing tasks, especially for derivative languages such as Arabic. However, stemming is faced with the problem of ambiguity, where two or more roots could be extracted from the same word. On the other hand, distributional semantics is a powerful co-occurrence model. It captures the meaning of a word based on its context. In this paper, a distributional semantics model utilizing Smoothed Pointwise Mutual Information (SPMI) is constructed to investigate its effectiveness on the stemming analysis task. It showed an accuracy of 81.5 stemmers.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/11/2020

I3rab: A New Arabic Dependency Treebank Based on Arabic Grammatical Theory

Treebanks are valuable linguistic resources that include the syntactic s...
research
02/07/2017

Fixing the Infix: Unsupervised Discovery of Root-and-Pattern Morphology

We present an unsupervised and language-agnostic method for learning roo...
research
03/09/2021

Combining Context-Free and Contextualized Representations for Arabic Sarcasm Detection and Sentiment Identification

Since their inception, transformer-based language models have led to imp...
research
03/12/2021

Automatic Romanization of Arabic Bibliographic Records

International library standards require cataloguers to tediously input R...
research
04/16/2021

LU-BZU at SemEval-2021 Task 2: Word2Vec and Lemma2Vec performance in Arabic Word-in-Context disambiguation

This paper presents a set of experiments to evaluate and compare between...
research
05/12/2023

Towards Transliteration between Sindhi Scripts from Devanagari to Perso-Arabic

In this paper, we have shown a script conversion (transliteration) techn...
research
12/24/2014

AltecOnDB: A Large-Vocabulary Arabic Online Handwriting Recognition Database

Arabic is a semitic language characterized by a complex and rich morphol...

Please sign up or login with your details

Forgot password? Click here to reset