Explainable Identification of Dementia from Transcripts using Transformer Networks

09/14/2021
by   Loukas Ilias, et al.
0

Alzheimer's disease (AD) is the main cause of dementia which is accompanied by loss of memory and may lead to severe consequences in peoples' everyday life if not diagnosed on time. Very few works have exploited transformer-based networks and despite the high accuracy achieved, little work has been done in terms of model interpretability. In addition, although Mini-Mental State Exam (MMSE) scores are inextricably linked with the identification of dementia, research works face the task of dementia identification and the task of the prediction of MMSE scores as two separate tasks. In order to address these limitations, we employ several transformer-based models, with BERT achieving the highest accuracy accounting for 85.56 interpretable method to detect AD patients based on siamese networks reaching accuracy up to 81.18 the main task refers to the identification of dementia (binary classification), while the auxiliary one corresponds to the identification of the severity of dementia (multiclass classification). Our model obtains accuracy equal to 84.99 Finally, we present some new methods to identify the linguistic patterns used by AD patients and non-AD ones, including text statistics, vocabulary uniqueness, word usage, correlations via a detailed linguistic analysis, and explainability techniques (LIME). Findings indicate significant differences in language between AD and non-AD patients.

READ FULL TEXT
research
04/17/2018

Detecting Linguistic Characteristics of Alzheimer's Dementia by Interpreting Neural Models

Alzheimer's disease (AD) is an irreversible and progressive brain diseas...
research
09/13/2022

Acoustic-Linguistic Features for Modeling Neurological Task Score in Alzheimer's

The average life expectancy is increasing globally due to advancements i...
research
07/05/2022

CASHformer: Cognition Aware SHape Transformer for Longitudinal Analysis

Modeling temporal changes in subcortical structures is crucial for a bet...
research
11/28/2020

Understanding How BERT Learns to Identify Edits

Pre-trained transformer language models such as BERT are ubiquitous in N...
research
06/12/2020

Comparing Natural Language Processing Techniques for Alzheimer's Dementia Prediction in Spontaneous Speech

Alzheimer's Dementia (AD) is an incurable, debilitating, and progressive...
research
01/20/2020

Recommending Themes for Ad Creative Design via Visual-Linguistic Representations

There is a perennial need in the online advertising industry to refresh ...
research
02/17/2021

SciDr at SDU-2020: IDEAS – Identifying and Disambiguating Everyday Acronyms for Scientific Domain

We present our systems submitted for the shared tasks of Acronym Identif...

Please sign up or login with your details

Forgot password? Click here to reset