A Machine Learning Approach to Persian Text Readability Assessment Using a Crowdsourced Dataset

10/07/2018
by   Hamid Mohammadi, et al.
0

An automated approach to text readability assessment is essential to a language and can be a powerful tool for improving the understandability of texts written and published in that language. However, the Persian language, which is spoken by over 110 million speakers wikipedia_2018, lacks such a system. Unlike other languages such as English, French, and Chinese, very limited research studies have been carried out to build an accurate and reliable text readability assessment system for the Persian language. In the present research, the first Persian dataset for text readability assessment was gathered and the first model for Persian text readability assessment using machine learning was introduced. The experiments showed that this model was accurate and could assess the readability of Persian texts with a high degree of confidence. The results of this study can be used in a number of applications such as medical and educational text readability evaluation and have the potential to be the cornerstone of future studies in Persian text readability assessment.

READ FULL TEXT
research
10/26/2020

LXPER Index 2.0: Improving Text Readability Assessment for L2 English Learners in South Korea

Most text readability assessment models are developed for the native rea...
research
12/12/2019

Text as Environment: A Deep Reinforcement Learning Text Readability Assessment Model

Evaluating the readability of a text can significantly facilitate the pr...
research
03/25/2022

Plagiarism Detection in the Bengali Language: A Text Similarity-Based Approach

Plagiarism means taking another person's work and not giving any credit ...
research
10/19/2020

Machine Learning Evaluation of the Echo-Chamber Effect in Medical Forums

We propose the Echo-Chamber Effect assessment of an online forum. Sentim...
research
02/25/2023

Prompt-based Learning for Text Readability Assessment

We propose the novel adaptation of a pre-trained seq2seq model for reada...
research
02/03/2023

Towards a responsible machine learning approach to identify forced labor in fisheries

Many fishing vessels use forced labor, but identifying vessels that enga...
research
11/11/2020

Assessment of text coherence based on the cohesion estimation

In this paper, a graph-based coherence estimation method based on the co...

Please sign up or login with your details

Forgot password? Click here to reset