Multi-modal Point-of-Care Diagnostics for COVID-19 Based On Acoustics and Symptoms

06/01/2021
by   Srikanth Raj Chetupalli, et al.
0

The research direction of identifying acoustic bio-markers of respiratory diseases has received renewed interest following the onset of COVID-19 pandemic. In this paper, we design an approach to COVID-19 diagnostic using crowd-sourced multi-modal data. The data resource, consisting of acoustic signals like cough, breathing, and speech signals, along with the data of symptoms, are recorded using a web-application over a period of ten months. We investigate the use of statistical descriptors of simple time-frequency features for acoustic signals and binary features for the presence of symptoms. Unlike previous works, we primarily focus on the application of simple linear classifiers like logistic regression and support vector machines for acoustic data while decision tree models are employed on the symptoms data. We show that a multi-modal integration of acoustics and symptoms classifiers achieves an area-under-curve (AUC) of 92.40, a significant improvement over any individual modality. Several ablation experiments are also provided which highlight the acoustic and symptom dimensions that are important for the task of COVID-19 diagnostics.

READ FULL TEXT

page 1

page 3

page 7

page 8

research
06/15/2023

Med-MMHL: A Multi-Modal Dataset for Detecting Human- and LLM-Generated Misinformation in the Medical Domain

The pervasive influence of misinformation has far-reaching and detriment...
research
06/15/2021

SRIB Submission to Interspeech 2021 DiCOVA Challenge

The COVID-19 pandemic has resulted in more than 125 million infections a...
research
06/24/2022

Analyzing the impact of SARS-CoV-2 variants on respiratory sound signals

The COVID-19 outbreak resulted in multiple waves of infections that have...
research
01/22/2022

Supervised and Self-supervised Pretraining Based COVID-19 Detection Using Acoustic Breathing/Cough/Speech Signals

In this work, we propose a bi-directional long short-term memory (BiLSTM...
research
03/27/2018

Multi-Modal Data Augmentation for End-to-end ASR

We present a new end-to-end architecture for automatic speech recognitio...
research
04/22/2022

FAIR4Cov: Fused Audio Instance and Representation for COVID-19 Detection

Audio-based classification techniques on body sounds have long been stud...
research
06/10/2016

Automatic Genre and Show Identification of Broadcast Media

Huge amounts of digital videos are being produced and broadcast every da...

Please sign up or login with your details

Forgot password? Click here to reset