Transformers for 1D Signals in Parkinson's Disease Detection from Gait

04/01/2022
by   Duc Minh Dimitri Nguyen, et al.
0

This paper focuses on the detection of Parkinson's disease based on the analysis of a patient's gait. The growing popularity and success of Transformer networks in natural language processing and image recognition motivated us to develop a novel method for this problem based on an automatic features extraction via Transformers. The use of Transformers in 1D signal is not really widespread yet, but we show in this paper that they are effective in extracting relevant features from 1D signals. As Transformers require a lot of memory, we decoupled temporal and spatial information to make the model smaller. Our architecture used temporal Transformers, dimension reduction layers to reduce the dimension of the data, a spatial Transformer, two fully connected layers and an output layer for the final prediction. Our model outperforms the current state-of-the-art algorithm with 95.2% accuracy in distinguishing a Parkinsonian patient from a healthy one on the Physionet dataset. A key learning from this work is that Transformers allow for greater stability in results. The source code and pre-trained models are released in https://github.com/DucMinhDimitriNguyen/Transformers-for-1D-signals-in-Parkinson-s-disease-detection-from-gait.git

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/30/2021

Rethinking Spatial Dimensions of Vision Transformers

Vision Transformer (ViT) extends the application range of transformers f...
research
04/22/2021

Multiscale Vision Transformers

We present Multiscale Vision Transformers (MViT) for video and image rec...
research
06/30/2022

CTrGAN: Cycle Transformers GAN for Gait Transfer

We attempt for the first time to address the problem of gait transfer. I...
research
01/09/2023

Transformers as Policies for Variable Action Environments

In this project we demonstrate the effectiveness of the transformer enco...
research
09/17/2020

ISCAS at SemEval-2020 Task 5: Pre-trained Transformers for Counterfactual Statement Modeling

ISCAS participated in two subtasks of SemEval 2020 Task 5: detecting cou...
research
09/18/2022

EEG-Based Epileptic Seizure Prediction Using Temporal Multi-Channel Transformers

Epilepsy is one of the most common neurological diseases, characterized ...
research
02/12/2022

Indication as Prior Knowledge for Multimodal Disease Classification in Chest Radiographs with Transformers

When a clinician refers a patient for an imaging exam, they include the ...

Please sign up or login with your details

Forgot password? Click here to reset