DeepAI AI Chat
Log In Sign Up

Vision Transformer for COVID-19 CXR Diagnosis using Chest X-ray Feature Corpus

by   Sangjoon Park, et al.

Under the global COVID-19 crisis, developing robust diagnosis algorithm for COVID-19 using CXR is hampered by the lack of the well-curated COVID-19 data set, although CXR data with other disease are abundant. This situation is suitable for vision transformer architecture that can exploit the abundant unlabeled data using pre-training. However, the direct use of existing vision transformer that uses the corpus generated by the ResNet is not optimal for correct feature embedding. To mitigate this problem, we propose a novel vision Transformer by using the low-level CXR feature corpus that are obtained to extract the abnormal CXR features. Specifically, the backbone network is trained using large public datasets to obtain the abnormal features in routine diagnosis such as consolidation, glass-grass opacity (GGO), etc. Then, the embedded features from the backbone network are used as corpus for vision transformer training. We examine our model on various external test datasets acquired from totally different institutions to assess the generalization ability. Our experiments demonstrate that our method achieved the state-of-art performance and has better generalization capability, which are crucial for a widespread deployment.


Vision Transformer using Low-level Chest X-ray Feature Corpus for COVID-19 Diagnosis and Severity Quantification

Developing a robust algorithm to diagnose and quantify the severity of C...

Multi-Scale Feature Fusion using Parallel-Attention Block for COVID-19 Chest X-ray Diagnosis

Under the global COVID-19 crisis, accurate diagnosis of COVID-19 from Ch...

CNN-based Local Vision Transformer for COVID-19 Diagnosis

Deep learning technology can be used as an assistive technology to help ...

Vision Transformer based COVID-19 Detection using Chest X-rays

COVID-19 is a global pandemic, and detecting them is a momentous task fo...

Federated Split Vision Transformer for COVID-19 CXR Diagnosis using Task-Agnostic Training

Federated learning, which shares the weights of the neural network acros...

CMC v2: Towards More Accurate COVID-19 Detection with Discriminative Video Priors

This paper presents our solution for the 2nd COVID-19 Competition, occur...

Shoulder Implant X-Ray Manufacturer Classification: Exploring with Vision Transformer

Shoulder replacement surgery, also called total shoulder replacement, is...