A Longitudinal Multi-modal Dataset for Dementia Monitoring and Diagnosis

09/03/2021
by   Dimitris Gkoumas, et al.
0

Dementia is a family of neurogenerative conditions affecting memory and cognition in an increasing number of individuals in our globally aging population. Automated analysis of language, speech and paralinguistic indicators have been gaining popularity as potential indicators of cognitive decline. Here we propose a novel longitudinal multi-modal dataset collected from people with mild dementia and age matched controls over a period of several months in a natural setting. The multi-modal data consists of spoken conversations, a subset of which are transcribed, as well as typed and written thoughts and associated extra-linguistic information such as pen strokes and keystrokes. We describe the dataset in detail and proceed to focus on a task using the speech modality. The latter involves distinguishing controls from people with dementia by exploiting the longitudinal nature of the data. Our experiments showed significant differences in how the speech varied from session to session in the control and dementia groups.

READ FULL TEXT

page 3

page 4

research
08/30/2023

LLaSM: Large Language and Speech Model

Multi-modal large language models have garnered significant interest rec...
research
06/16/2022

Multi-View Imputation and Cross-Attention Network Based on Incomplete Longitudinal and Multi-Modal Data for Alzheimer's Disease Prediction

Longitudinal variations and complementary information inherent in longit...
research
09/30/2020

Ethically Collecting Multi-Modal Spontaneous Conversations with People that have Cognitive Impairments

In order to make spoken dialogue systems (such as Amazon Alexa or Google...
research
10/20/2018

Investigating Voice as a Biomarker for leucine-rich repeat kinase 2-Associated Parkinson's Disease

We investigate the potential association between leucine-rich repeat kin...
research
04/12/2016

Multi-modal Fusion for Diabetes Mellitus and Impaired Glucose Regulation Detection

Effective and accurate diagnosis of Diabetes Mellitus (DM), as well as i...
research
07/05/2022

Is a PET all you need? A multi-modal study for Alzheimer's disease using 3D CNNs

Alzheimer's Disease (AD) is the most common form of dementia and often d...
research
11/19/2020

Predicting Early Indicators of Cognitive Decline from Verbal Utterances

Dementia is a group of irreversible, chronic, and progressive neurodegen...

Please sign up or login with your details

Forgot password? Click here to reset