Improving EEG based Continuous Speech Recognition

11/24/2019
by   Gautam Krishna, et al.
0

In this paper we introduce various techniques to improve the performance of electroencephalography (EEG) features based continuous speech recognition (CSR) systems. A connectionist temporal classification (CTC) based automatic speech recognition (ASR) system was implemented for performing recognition. We introduce techniques to initialize the weights of the recurrent layers in the encoder of the CTC model with more meaningful weights rather than with random weights and we make use of an external language model to improve the beam search during decoding time. We finally study the problem of predicting articulatory features from EEG features in this paper.

READ FULL TEXT
research
12/16/2019

Continuous Speech Recognition using EEG and Video

In this paper we investigate whether electroencephalography (EEG) featur...
research
05/29/2020

Improving EEG based continuous speech recognition using GAN

In this paper we demonstrate that it is possible to generate more meanin...
research
03/15/2018

Advancing Connectionist Temporal Classification With Attention Modeling

In this study, we propose advancing all-neural speech recognition by dir...
research
02/28/2021

Brain Signals to Rescue Aphasia, Apraxia and Dysarthria Speech Recognition

In this paper, we propose a deep learning-based algorithm to improve the...
research
04/19/2023

CB-Conformer: Contextual biasing Conformer for biased word recognition

Due to the mismatch between the source and target domains, how to better...
research
06/01/2020

Constrained Variational Autoencoder for improving EEG based Speech Recognition Systems

In this paper we introduce a recurrent neural network (RNN) based variat...
research
05/08/2019

A Hardware-Oriented and Memory-Efficient Method for CTC Decoding

The Connectionist Temporal Classification (CTC) has achieved great succe...

Please sign up or login with your details

Forgot password? Click here to reset