Interpretable Deep Learning for the Remote Characterisation of Ambulation in Multiple Sclerosis using Smartphones

03/16/2021
by   Andrew P. Creagh, et al.
0

The emergence of digital technologies such as smartphones in healthcare applications have demonstrated the possibility of developing rich, continuous, and objective measures of multiple sclerosis (MS) disability that can be administered remotely and out-of-clinic. In this work, deep convolutional neural networks (DCNN) applied to smartphone inertial sensor data were shown to better distinguish healthy from MS participant ambulation, compared to standard Support Vector Machine (SVM) feature-based methodologies. To overcome the typical limitations associated with remotely generated health data, such as low subject numbers, sparsity, and heterogeneous data, a transfer learning (TL) model from similar large open-source datasets was proposed. Our TL framework utilised the ambulatory information learned on Human Activity Recognition (HAR) tasks collected from similar smartphone-based sensor data. A lack of transparency of "black-box" deep networks remains one of the largest stumbling blocks to the wider acceptance of deep learning for clinical applications. Ensuing work therefore aimed to visualise DCNN decisions attributed by relevance heatmaps using Layer-Wise Relevance Propagation (LRP). Through the LRP framework, the patterns captured from smartphone-based inertial sensor data that were reflective of those who are healthy versus persons with MS (PwMS) could begin to be established and understood. Interpretations suggested that cadence-based measures, gait speed, and ambulation-related signal perturbations were distinct characteristics that distinguished MS disability from healthy participants. Robust and interpretable outcomes, generated from high-frequency out-of-clinic assessments, could greatly augment the current in-clinic assessment picture for PwMS, to inform better disease management techniques, and enable the development of better therapeutic interventions.

READ FULL TEXT

page 6

page 7

page 8

research
05/28/2021

Inertial Sensor Data To Image Encoding For Human Action Recognition

Convolutional Neural Networks (CNNs) are successful deep learning models...
research
12/03/2018

An Interpretable Machine Vision Approach to Human Activity Recognition using Photoplethysmograph Sensor Data

The current gold standard for human activity recognition (HAR) is based ...
research
01/02/2020

A Deep Learning Approach to Diagnosing Multiple Sclerosis from Smartphone Data

Multiple sclerosis (MS) affects the central nervous system with a wide r...
research
08/31/2018

Cardiopulmonary Resuscitation Quality Parameters from Inertial Sensor Data using Differential Evolution Fitting of Sinusoids

In this paper, we present a robust sinusoidal model fitting method based...
research
10/11/2019

A modified Genetic Algorithm for continuous estimation of CPR quality parameters from wrist-worn inertial sensor data

Cardiopulmonary resuscitation (CPR) is the most important emergency inte...
research
04/17/2023

In-situ surface porosity prediction in DED (directed energy deposition) printed SS316L parts using multimodal sensor fusion

This study aims to relate the time-frequency patterns of acoustic emissi...

Please sign up or login with your details

Forgot password? Click here to reset