DeepAI AI Chat
Log In Sign Up

Extracting and Learning Fine-Grained Labels from Chest Radiographs

by   Tanveer Syeda-Mahmood, et al.

Chest radiographs are the most common diagnostic exam in emergency rooms and intensive care units today. Recently, a number of researchers have begun working on large chest X-ray datasets to develop deep learning models for recognition of a handful of coarse finding classes such as opacities, masses and nodules. In this paper, we focus on extracting and learning fine-grained labels for chest X-ray images. Specifically we develop a new method of extracting fine-grained labels from radiology reports by combining vocabulary-driven concept extraction with phrasal grouping in dependency parse trees for association of modifiers with findings. A total of 457 fine-grained labels depicting the largest spectrum of findings to date were selected and sufficiently large datasets acquired to train a new deep learning model designed for fine-grained classification. We show results that indicate a highly accurate label extraction process and a reliable learning of fine-grained labels. The resulting network, to our knowledge, is the first to recognize fine-grained descriptions of findings in images covering over nine modifiers including laterality, location, severity, size and appearance.


page 1

page 9


Chest X-ray Report Generation through Fine-Grained Label Learning

Obtaining automated preliminary read reports for common exams such as ch...

Probabilistic Integration of Object Level Annotations in Chest X-ray Classification

Medical image datasets and their annotations are not growing as fast as ...

Spatially-Preserving Flattening for Location-Aware Classification of Findings in Chest X-Rays

Chest X-rays have become the focus of vigorous deep learning research in...

Leveraging Spatial Information in Radiology Reports for Ischemic Stroke Phenotyping

Classifying fine-grained ischemic stroke phenotypes relies on identifyin...

Commonsense Knowledge Assisted Deep Learning for Resource-constrained and Fine-grained Object Detection

In this paper, we consider fine-grained image object detection in resour...

Efficient Algorithms for Learning from Coarse Labels

For many learning problems one may not have access to fine grained label...

Identifying ARDS using the Hierarchical Attention Network with Sentence Objectives Framework

Acute respiratory distress syndrome (ARDS) is a life-threatening conditi...