Beyond Arabic: Software for Perso-Arabic Script Manipulation

01/26/2023
by   Alexander Gutkin, et al.
0

This paper presents an open-source software library that provides a set of finite-state transducer (FST) components and corresponding utilities for manipulating the writing systems of languages that use the Perso-Arabic script. The operations include various levels of script normalization, including visual invariance-preserving operations that subsume and go beyond the standard Unicode normalization forms, as well as transformations that modify the visual appearance of characters in accordance with the regional orthographies for eleven contemporary languages from diverse language families. The library also provides simple FST-based romanization and transliteration. We additionally attempt to formalize the typology of Perso-Arabic characters by providing one-to-many mappings from Unicode code points to the languages that use them. While our work focuses on the Arabic script diaspora rather than Arabic itself, this approach could be adopted for any language that uses the Arabic script, thus providing a unified framework for treating a script family used by close to a billion people.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/21/2022

Graphemic Normalization of the Perso-Arabic Script

Since its original appearance in 1991, the Perso-Arabic script represent...
research
05/07/2015

Contextual Analysis for Middle Eastern Languages with Hidden Markov Models

Displaying a document in Middle Eastern languages requires contextual an...
research
11/07/2014

Azhary: An Arabic Lexical Ontology

Arabic language is the most spoken languages in the Semitic languages gr...
research
12/13/2014

A Study of Sindhi Related and Arabic Script Adapted languages Recognition

A large number of publications are available for the Optical Character R...
research
10/24/2022

Maknuune: A Large Open Palestinian Arabic Lexicon

We present Maknuune, a large open lexicon for the Palestinian Arabic dia...
research
05/05/2020

Digraph of Senegal s local languages: issues, challenges and prospects of their transliteration

The local languages in Senegal, like those of West African countries in ...
research
06/18/2022

MANorm: A Normalization Dictionary for Moroccan Arabic Dialect Written in Latin Script

Social media user-generated text is actually the main resource for many ...

Please sign up or login with your details

Forgot password? Click here to reset