Log In Sign Up

Transforming unstructured voice and text data into insight for paramedic emergency service using recurrent and convolutional neural networks

by   Kyongsik Yun, et al.

Paramedics often have to make lifesaving decisions within a limited time in an ambulance. They sometimes ask the doctor for additional medical instructions, during which valuable time passes for the patient. This study aims to automatically fuse voice and text data to provide tailored situational awareness information to paramedics. To train and test speech recognition models, we built a bidirectional deep recurrent neural network (long short-term memory (LSTM)). Then we used convolutional neural networks on top of custom-trained word vectors for sentence-level classification tasks. Each sentence is automatically categorized into four classes, including patient status, medical history, treatment plan, and medication reminder. Subsequently, incident reports were automatically generated to extract keywords and assist paramedics and physicians in making decisions. The proposed system found that it could provide timely medication notifications based on unstructured voice and text data, which was not possible in paramedic emergencies at present. In addition, the automatic incident report generation provided by the proposed system improves the routine but error-prone tasks of paramedics and doctors, helping them focus on patient care.


A Deep Learning Approach to Predicting Ventilator Parameters for Mechanically Ventilated Septic Patients

We develop a deep learning approach to predicting a set of ventilator pa...

Voice Disorder Detection Using Long Short Term Memory (LSTM) Model

Automated detection of voice disorders with computational methods is a r...

Increasing the Interpretability of Recurrent Neural Networks Using Hidden Markov Models

As deep neural networks continue to revolutionize various application do...

Inner speech recognition through electroencephalographic signals

This work focuses on inner speech recognition starting from EEG signals....

RETURNN: The RWTH Extensible Training framework for Universal Recurrent Neural Networks

In this work we release our extensible and easily configurable neural ne...

SmartTriage: A system for personalized patient data capture, documentation generation, and decision support

Symptom checkers have emerged as an important tool for collecting sympto...

Effects of Voice-Based Synthetic Assistant on Performance of Emergency Care Provider in Training

As part of a perennial project, our team is actively engaged in developi...