Pushing on Text Readability Assessment: A Transformer Meets Handcrafted Linguistic Features

09/25/2021
by   Bruce W. Lee, et al.
0

We report two essential improvements in readability assessment: 1. three novel features in advanced semantics and 2. the timely evidence that traditional ML models (e.g. Random Forest, using handcrafted features) can combine with transformers (e.g. RoBERTa) to augment model performance. First, we explore suitable transformers and traditional ML models. Then, we extract 255 handcrafted linguistic features using self-developed extraction software. Finally, we assemble those to create several hybrid models, achieving state-of-the-art (SOTA) accuracy on popular datasets in readability assessment. The use of handcrafted features help model performance on smaller datasets. Notably, our RoBERTA-RF-T1 hybrid achieves the near-perfect classification accuracy of 99

READ FULL TEXT
research
06/06/2023

Exploring Linguistic Features for Turkish Text Readability

This paper presents the first comprehensive study on automatic readabili...
research
10/21/2022

Feature Engineering and Classification Models for Partial Discharge in Power Transformers

To ensure reliability, power transformers are monitored for partial disc...
research
05/30/2020

Linguistic Features for Readability Assessment

Readability assessment aims to automatically classify text by the level ...
research
10/19/2022

A Unified Neural Network Model for Readability Assessment with Feature Projection and Length-Balanced Loss

For readability assessment, traditional methods mainly employ machine le...
research
03/31/2022

A Baseline Readability Model for Cebuano

In this study, we developed the first baseline readability model for the...
research
06/25/2022

Protoformer: Embedding Prototypes for Transformers

Transformers have been widely applied in text classification. Unfortunat...
research
05/22/2023

Automatic Readability Assessment for Closely Related Languages

In recent years, the main focus of research on automatic readability ass...

Please sign up or login with your details

Forgot password? Click here to reset