A Novel RL-assisted Deep Learning Framework for Task-informative Signals Selection and Classification for Spontaneous BCIs

07/01/2020
by   Wonjun Ko, et al.
0

In this work, we formulate the problem of estimating and selecting task-relevant temporal signal segments from a single EEG trial in the form of a Markov decision process and propose a novel reinforcement-learning mechanism that can be combined with the existing deep-learning based BCI methods. To be specific, we devise an actor-critic network such that an agent can determine which timepoints need to be used (informative) or discarded (uninformative) in composing the intention-related features in a given trial, and thus enhancing the intention identification performance. To validate the effectiveness of our proposed method, we conducted experiments with a publicly available big MI dataset and applied our novel mechanism to various recent deep-learning architectures designed for MI classification. Based on the exhaustive experiments, we observed that our proposed method helped achieve statistically significant improvements in performance.

READ FULL TEXT

page 1

page 7

research
10/01/2021

Divergence-Regularized Multi-Agent Actor-Critic

Entropy regularization is a popular method in reinforcement learning (RL...
research
12/13/2022

CropCat: Data Augmentation for Smoothing the Feature Distribution of EEG Signals

Brain-computer interface (BCI) is a communication system between humans ...
research
12/08/2021

Hyper-parameter optimization based on soft actor critic and hierarchical mixture regularization

Hyper-parameter optimization is a crucial problem in machine learning as...
research
07/24/2020

Selection of Proper EEG Channels for Subject Intention Classification Using Deep Learning

Brain signals could be used to control devices to assist individuals wit...
research
09/27/2022

Regularized Soft Actor-Critic for Behavior Transfer Learning

Existing imitation learning methods mainly focus on making an agent effe...
research
07/04/2018

Supervised Reinforcement Learning with Recurrent Neural Network for Dynamic Treatment Recommendation

Dynamic treatment recommendation systems based on large-scale electronic...

Please sign up or login with your details

Forgot password? Click here to reset