Investigating the Utility of Multimodal Conversational Technology and Audiovisual Analytic Measures for the Assessment and Monitoring of Amyotrophic Lateral Sclerosis at Scale

by   Michael Neumann, et al.

We propose a cloud-based multimodal dialog platform for the remote assessment and monitoring of Amyotrophic Lateral Sclerosis (ALS) at scale. This paper presents our vision, technology setup, and an initial investigation of the efficacy of the various acoustic and visual speech metrics automatically extracted by the platform. 82 healthy controls and 54 people with ALS (pALS) were instructed to interact with the platform and completed a battery of speaking tasks designed to probe the acoustic, articulatory, phonatory, and respiratory aspects of their speech. We find that multiple acoustic (rate, duration, voicing) and visual (higher order statistics of the jaw and lip) speech metrics show statistically significant differences between controls, bulbar symptomatic and bulbar pre-symptomatic patients. We report on the sensitivity and specificity of these metrics using five-fold cross-validation. We further conducted a LASSO-LARS regression analysis to uncover the relative contributions of various acoustic and visual features in predicting the severity of patients' ALS (as measured by their self-reported ALSFRS-R scores). Our results provide encouraging evidence of the utility of automatically extracted audiovisual analytics for scalable remote patient assessment and monitoring in ALS.



There are no comments yet.


page 4


Respiratory Distress Detection from Telephone Speech using Acoustic and Prosodic Features

With the widespread use of telemedicine services, automatic assessment o...

A Multimodal Approach for Automatic Mania Assessment in Bipolar Disorder

Bipolar disorder is a mental health disorder that causes mood swings tha...

Voice Biomarker Identification for Effects of Deep-Brain Stimulation on Parkinson's Disease

Deep-Brain Stimulation (DBS) is a therapy used in conjunction with medic...

Classification of ALS patients based on acoustic analysis of sustained vowel phonations

Amyotrophic lateral sclerosis (ALS) is incurable neurological disorder w...

Semantic Characteristics of Schizophrenic Speech

Natural language processing tools are used to automatically detect distu...

Predicting interviewee attitude and body language from speech descriptors

This present research investigated the relationship between personal imp...

Identifying Mood Episodes Using Dialogue Features from Clinical Interviews

Bipolar disorder, a severe chronic mental illness characterized by patho...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.