COVID-19 Detection from Respiratory Sounds with Hierarchical Spectrogram Transformers

07/19/2022
by   Idil Aytekin, et al.
18

Monitoring of prevalent airborne diseases such as COVID-19 characteristically involve respiratory assessments. While auscultation is a mainstream method for symptomatic monitoring, its diagnostic utility is hampered by the need for dedicated hospital visits. Continual remote monitoring based on recordings of respiratory sounds on portable devices is a promising alternative, which can assist in screening of COVID-19. In this study, we introduce a novel deep learning approach to distinguish patients with COVID-19 from healthy controls given audio recordings of cough or breathing sounds. The proposed approach leverages a novel hierarchical spectrogram transformer (HST) on spectrogram representations of respiratory sounds. HST embodies self-attention mechanisms over local windows in spectrograms, and window size is progressively grown over model stages to capture local to global context. HST is compared against state-of-the-art conventional and deep-learning baselines. Comprehensive demonstrations on a multi-national dataset indicate that HST outperforms competing methods, achieving over 97 characteristic curve (AUC) in detecting COVID-19 cases.

READ FULL TEXT

page 1

page 8

research
07/30/2021

Evaluating the COVID-19 Identification ResNet (CIdeR) on the INTERSPEECH COVID-19 from Audio Challenges

We report on cross-running the recent COVID-19 Identification ResNet (CI...
research
04/22/2022

FAIR4Cov: Fused Audio Instance and Representation for COVID-19 Detection

Audio-based classification techniques on body sounds have long been stud...
research
11/22/2022

COVID-Net Assistant: A Deep Learning-Driven Virtual Assistant for COVID-19 Symptom Prediction and Recommendation

As the COVID-19 pandemic continues to put a significant burden on health...
research
06/10/2020

Exploring Automatic Diagnosis of COVID-19 from Crowdsourced Respiratory Sound Data

Audio signals generated by the human body (e.g., sighs, breathing, heart...
research
07/12/2021

Project Achoo: A Practical Model and Application for COVID-19 Detection from Recordings of Breath, Voice, and Cough

The COVID-19 pandemic created a significant interest and demand for infe...
research
12/20/2022

Visual Transformers for Primates Classification and Covid Detection

We apply the vision transformer, a deep machine learning model build aro...

Please sign up or login with your details

Forgot password? Click here to reset