Multi-Label Generalized Zero Shot Learning for the Classification of Disease in Chest Radiographs

07/14/2021
by   Nasir Hayat, et al.
0

Despite the success of deep neural networks in chest X-ray (CXR) diagnosis, supervised learning only allows the prediction of disease classes that were seen during training. At inference, these networks cannot predict an unseen disease class. Incorporating a new class requires the collection of labeled data, which is not a trivial task, especially for less frequently-occurring diseases. As a result, it becomes inconceivable to build a model that can diagnose all possible disease classes. Here, we propose a multi-label generalized zero shot learning (CXR-ML-GZSL) network that can simultaneously predict multiple seen and unseen diseases in CXR images. Given an input image, CXR-ML-GZSL learns a visual representation guided by the input's corresponding semantics extracted from a rich medical text corpus. Towards this ambitious goal, we propose to map both visual and semantic modalities to a latent feature space using a novel learning objective. The objective ensures that (i) the most relevant labels for the query image are ranked higher than irrelevant labels, (ii) the network learns a visual representation that is aligned with its semantics in the latent feature space, and (iii) the mapped semantics preserve their original inter-class representation. The network is end-to-end trainable and requires no independent pre-training for the offline feature extractor. Experiments on the NIH Chest X-ray dataset show that our network outperforms two strong baselines in terms of recall, precision, f1 score, and area under the receiver operating characteristic curve. Our code is publicly available at: https://github.com/nyuad-cai/CXR-ML-GZSL.git

READ FULL TEXT
research
11/17/2017

Multi-Label Zero-Shot Learning with Structured Knowledge Graphs

In this paper, we propose a novel deep learning architecture for multi-l...
research
01/27/2021

Generative Multi-Label Zero-Shot Learning

Multi-label zero-shot learning strives to classify images into multiple ...
research
03/26/2015

Transductive Multi-label Zero-shot Learning

Zero-shot learning has received increasing interest as a means to allevi...
research
08/20/2021

Discriminative Region-based Multi-Label Zero-Shot Learning

Multi-label zero-shot learning (ZSL) is a more realistic counter-part of...
research
02/03/2021

Isometric Propagation Network for Generalized Zero-shot Learning

Zero-shot learning (ZSL) aims to classify images of an unseen class only...
research
09/08/2023

Generalized Cross-domain Multi-label Few-shot Learning for Chest X-rays

Real-world application of chest X-ray abnormality classification require...
research
02/05/2021

Multi-Label Annotation of Chest Abdomen Pelvis Computed Tomography Text Reports Using Deep Learning

To develop a high throughput multi-label annotator for body Computed Tom...

Please sign up or login with your details

Forgot password? Click here to reset