DeepAI AI Chat
Log In Sign Up

Automated Generation of Accurate & Fluent Medical X-ray Reports

by   Hoang T. N. Nguyen, et al.

Our paper focuses on automating the generation of medical reports from chest X-ray image inputs, a critical yet time-consuming task for radiologists. Unlike existing medical re-port generation efforts that tend to produce human-readable reports, we aim to generate medical reports that are both fluent and clinically accurate. This is achieved by our fully differentiable and end-to-end paradigm containing three complementary modules: taking the chest X-ray images and clinical his-tory document of patients as inputs, our classification module produces an internal check-list of disease-related topics, referred to as enriched disease embedding; the embedding representation is then passed to our transformer-based generator, giving rise to the medical reports; meanwhile, our generator also pro-duces the weighted embedding representation, which is fed to our interpreter to ensure consistency with respect to disease-related topics.Our approach achieved promising results on commonly-used metrics concerning language fluency and clinical accuracy. Moreover, noticeable performance gains are consistently ob-served when additional input information is available, such as the clinical document and extra scans of different views.


page 1

page 2

page 3

page 4


Clinically Accurate Chest X-Ray Report Generation

The automatic generation of radiology reports given medical radiographs ...

Automated Knee X-ray Report Generation

Gathering manually annotated images for the purpose of training a predic...

Boosting Radiology Report Generation by Infusing Comparison Prior

Current transformer-based models achieved great success in generating ra...

CREATe: Clinical Report Extraction and Annotation Technology

Clinical case reports are written descriptions of the unique aspects of ...

Few-shot Structured Radiology Report Generation Using Natural Language Prompts

Chest radiograph reporting is time-consuming, and numerous solutions to ...

Attributed Abnormality Graph Embedding for Clinically Accurate X-Ray Report Generation

Automatic generation of medical reports from X-ray images can assist rad...

Self adaptive global-local feature enhancement for radiology report generation

Automated radiology report generation aims at automatically generating a...