Lexical Simplification Benchmarks for English, Portuguese, and Spanish

09/12/2022
by   Sanja Štajner, et al.
0

Even in highly-developed countries, as many as 15-30% of the population can only understand texts written using a basic vocabulary. Their understanding of everyday texts is limited, which prevents them from taking an active role in society and making informed decisions regarding healthcare, legal representation, or democratic choice. Lexical simplification is a natural language processing task that aims to make text understandable to everyone by replacing complex vocabulary and expressions with simpler ones, while preserving the original meaning. It has attracted considerable attention in the last 20 years, and fully automatic lexical simplification systems have been proposed for various languages. The main obstacle for the progress of the field is the absence of high-quality datasets for building and evaluating lexical simplification systems. We present a new benchmark dataset for lexical simplification in English, Spanish, and (Brazilian) Portuguese, and provide details about data selection and annotation procedures. This is the first dataset that offers a direct comparison of lexical simplification systems for three languages. To showcase the usability of the dataset, we adapt two state-of-the-art lexical simplification systems with differing architectures (neural vs. non-neural) to all three languages (English, Spanish, and Brazilian Portuguese) and evaluate their performances on our new dataset. For a fairer comparison, we use several evaluation measures which capture varied aspects of the systems' efficacy, and discuss their strengths and weaknesses. We find a state-of-the-art neural lexical simplification system outperforms a state-of-the-art non-neural lexical simplification system in all three languages. More importantly, we find that the state-of-the-art neural lexical simplification systems perform significantly better for English than for Spanish and Portuguese.

READ FULL TEXT
research
10/14/2020

Chinese Lexical Simplification

Lexical simplification has attracted much attention in many languages, w...
research
02/06/2023

Findings of the TSAR-2022 Shared Task on Multilingual Lexical Simplification

We report findings of the TSAR-2022 shared task on multilingual lexical ...
research
02/17/2021

Predicting Lexical Complexity in English Texts

The first step in most text simplification is to predict which words are...
research
05/05/2020

Russian Natural Language Generation: Creation of a Language Modelling Dataset and Evaluation with Modern Neural Architectures

Generating coherent, grammatically correct, and meaningful text is very ...
research
06/12/2016

External Lexical Information for Multilingual Part-of-Speech Tagging

Morphosyntactic lexicons and word vector representations have both prove...
research
02/03/2023

Lexical Simplification using multi level and modular approach

Text Simplification is an ongoing problem in Natural Language Processing...
research
07/10/2023

Measuring Lexical Diversity in Texts: The Twofold Length Problem

The impact of text length on the estimation of lexical diversity has cap...

Please sign up or login with your details

Forgot password? Click here to reset