PicTalky: Augmentative and Alternative Communication Software for Language Developmental Disabilities

09/27/2021
by   Chanjun Park, et al.
0

Augmentative and alternative communication (AAC) is a practical means of communication for people with language disabilities. In this study, we propose PicTalky, which is an AI-based AAC system that helps children with language developmental disabilities to improve their communication skills and language comprehension abilities. PicTalky can process both text and pictograms more accurately by connecting a series of neural-based NLP modules. Moreover, we perform quantitative and qualitative analyses on the essential features of PicTalky. It is expected that those suffering from language problems will be able to express their intentions or desires more easily and improve their quality of life by using this service. We have made the models freely available alongside a demonstration of the Web interface. Furthermore, we implemented robotics AAC for the first time by applying PicTalky to the NAO robot.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/09/2023

Using the power of memes: The Pepper Robot as a communicative facilitator for autistic children (cAESAR2023 workshop)

This article describes the preliminary qualitative results of a therapeu...
research
10/31/2018

Real-time Automatic Word Segmentation for User-generated Text

For readability and possibly for disambiguation, appropriate word segmen...
research
10/02/2022

ALT: A software for readability analysis of Portuguese-language texts

In the initial stage of human life, communication, seen as a process of ...
research
04/27/2021

Arthur: a new ECA that uses Memory to improve Communication

This article proposes an embodied conversational agent named Arthur. In ...
research
11/10/2021

Tawsol Symbols 3D – Towards an innovative Picture Exchange Communication Systems PECS

Pictograms (also called symbols) are widely used in daily life as a type...
research
06/07/2019

Improving the communication for children with speech disorder using the smart toys

An attempt is made to develop a smart toy to help the children suffering...
research
03/23/2022

ALT: um software para análise de legibilidade de textos em Língua Portuguesa

In the initial stage of human life, communication, seen as a process of ...

Please sign up or login with your details

Forgot password? Click here to reset