Extracting and Learning Fine-Grained Labels from Chest Radiographs

by   Tanveer Syeda-Mahmood, et al.

Chest radiographs are the most common diagnostic exam in emergency rooms and intensive care units today. Recently, a number of researchers have begun working on large chest X-ray datasets to develop deep learning models for recognition of a handful of coarse finding classes such as opacities, masses and nodules. In this paper, we focus on extracting and learning fine-grained labels for chest X-ray images. Specifically we develop a new method of extracting fine-grained labels from radiology reports by combining vocabulary-driven concept extraction with phrasal grouping in dependency parse trees for association of modifiers with findings. A total of 457 fine-grained labels depicting the largest spectrum of findings to date were selected and sufficiently large datasets acquired to train a new deep learning model designed for fine-grained classification. We show results that indicate a highly accurate label extraction process and a reliable learning of fine-grained labels. The resulting network, to our knowledge, is the first to recognize fine-grained descriptions of findings in images covering over nine modifiers including laterality, location, severity, size and appearance.



There are no comments yet.


page 1

page 9


Chest X-ray Report Generation through Fine-Grained Label Learning

Obtaining automated preliminary read reports for common exams such as ch...

Building a Benchmark Dataset and Classifiers for Sentence-Level Findings in AP Chest X-rays

Chest X-rays are the most common diagnostic exams in emergency rooms and...

KFWC: A Knowledge-Driven Deep Learning Model for Fine-grained Classification of Wet-AMD

Automated diagnosis using deep neural networks can help ophthalmologists...

Leveraging Spatial Information in Radiology Reports for Ischemic Stroke Phenotyping

Classifying fine-grained ischemic stroke phenotypes relies on identifyin...

Tips and Tricks for Webly-Supervised Fine-Grained Recognition: Learning from the WebFG 2020 Challenge

WebFG 2020 is an international challenge hosted by Nanjing University of...

Chest X-rays Classification: A Multi-Label and Fine-Grained Problem

The widely used ChestX-ray14 dataset addresses an important medical imag...

Identifying ARDS using the Hierarchical Attention Network with Sentence Objectives Framework

Acute respiratory distress syndrome (ARDS) is a life-threatening conditi...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.