Deep Real-Time Decoding of bimanual grip force from EEG fNIRS

03/09/2021
by   Pablo Ortega, et al.
0

Non-invasive cortical neural interfaces have only achieved modest performance in cortical decoding of limb movements and their forces, compared to invasive brain-computer interfaces (BCIs). While non-invasive methodologies are safer, cheaper and vastly more accessible technologies, signals suffer from either poor resolution in the space domain (EEG) or the temporal domain (BOLD signal of functional Near Infrared Spectroscopy, fNIRS). The non-invasive BCI decoding of bimanual force generation and the continuous force signal has not been realised before and so we introduce an isometric grip force tracking task to evaluate the decoding. We find that combining EEG and fNIRS using deep neural networks works better than linear models to decode continuous grip force modulations produced by the left and the right hand. Our multi-modal deep learning decoder achieves 55.2 FVAF[ decoding performance by at least 15 show a way to achieve continuous hand force decoding using cortical signals obtained with non-invasive mobile brain imaging has immediate impact for rehabilitation, restoration and consumer applications.

READ FULL TEXT

page 1

page 2

research
07/17/2019

Deep Invertible Networks for EEG-based brain-signal decoding

In this manuscript, we investigate deep invertible networks for EEG-base...
research
03/09/2021

HemCNN: Deep Learning enables decoding of fNIRS cortical signals in hand grip motor tasks

We solve the fNIRS left/right hand force decoding problem using a data-d...
research
02/03/2023

Relating EEG to continuous speech using deep neural networks: a review

Objective. When a person listens to continuous speech, a corresponding r...
research
10/05/2022

MAtt: A Manifold Attention Network for EEG Decoding

Recognition of electroencephalographic (EEG) signals highly affect the e...
research
11/28/2018

Towards Neural Co-Processors: Combining Neural Decoding and Encoding in Brain-Computer Interfaces

The field of brain-computer interfaces is poised to advance from the tra...
research
03/27/2018

Re-thinking EEG-based non-invasive brain interfaces: modeling and analysis

Brain interfaces are cyber-physical systems that aim to harvest informat...

Please sign up or login with your details

Forgot password? Click here to reset