COVID-19 Pneumonia Severity Prediction using Hybrid Convolution-Attention Neural Architectures

07/06/2021
by   Nam Nguyen, et al.
0

This study proposed a novel framework for COVID-19 severity prediction, which is a combination of data-centric and model-centric approaches. First, we propose a data-centric pre-training for extremely scare data scenarios of the investigating dataset. Second, we propose two hybrid convolution-attention neural architectures that leverage the self-attention from the Transformer and the Dense Associative Memory (Modern Hopfield networks). Our proposed approach achieves significant improvement from the conventional baseline approach. The best model from our proposed approach achieves R^2 = 0.85 ± 0.05 and Pearson correlation coefficient ρ = 0.92 ± 0.02 in geographic extend and R^2 = 0.72 ± 0.09, ρ = 0.85± 0.06 in opacity prediction.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/23/2019

A Transformer with Interleaved Self-attention and Convolution for Hybrid Acoustic Models

Transformer with self-attention has achieved great success in the area o...
research
12/08/2021

Transformer based trajectory prediction

To plan a safe and efficient route, an autonomous vehicle should anticip...
research
03/15/2023

2D and 3D CNN-Based Fusion Approach for COVID-19 Severity Prediction from 3D CT-Scans

Since the appearance of Covid-19 in late 2019, Covid-19 has become an ac...
research
04/11/2019

An Empirical Study of Spatial Attention Mechanisms in Deep Networks

Attention mechanisms have become a popular component in deep neural netw...
research
06/02/2023

A Novel Vision Transformer with Residual in Self-attention for Biomedical Image Classification

Biomedical image classification requires capturing of bio-informatics ba...
research
05/15/2023

Towards Automated COVID-19 Presence and Severity Classification

COVID-19 presence classification and severity prediction via (3D) thorax...
research
03/14/2022

Simplicial Attention Neural Networks

The aim of this work is to introduce simplicial attention networks (SANs...

Please sign up or login with your details

Forgot password? Click here to reset