Explaining Chest X-ray Pathologies in Natural Language

07/09/2022
by   Maxime Kayser, et al.
92

Most deep learning algorithms lack explanations for their predictions, which limits their deployment in clinical practice. Approaches to improve explainability, especially in medical imaging, have often been shown to convey limited information, be overly reassuring, or lack robustness. In this work, we introduce the task of generating natural language explanations (NLEs) to justify predictions made on medical images. NLEs are human-friendly and comprehensive, and enable the training of intrinsically explainable models. To this goal, we introduce MIMIC-NLE, the first, large-scale, medical imaging dataset with NLEs. It contains over 38,000 NLEs, which explain the presence of various thoracic pathologies and chest X-ray findings. We propose a general approach to solve the task and evaluate several architectures on this dataset, including via clinician assessment.

READ FULL TEXT
01/12/2021

Pneumonia Detection on Chest X-ray using Radiomic Features and Contrastive Learning

Chest X-ray becomes one of the most common medical diagnoses due to its ...
12/30/2019

A New Approach for Explainable Multiple Organ Annotation with Few Data

Despite the recent successes of deep learning, such models are still far...
01/23/2020

Localization of Critical Findings in Chest X-Ray without Local Annotations Using Multi-Instance Learning

The automatic detection of critical findings in chest X-rays (CXR), such...
01/21/2019

MIMIC-CXR: A large publicly available database of labeled chest radiographs

Chest radiography is an extremely powerful imaging modality, allowing fo...
11/24/2021

Explainable multiple abnormality classification of chest CT volumes with AxialNet and HiResCAM

Understanding model predictions is critical in healthcare, to facilitate...
10/15/2020

Data Valuation for Medical Imaging Using Shapley Value: Application on A Large-scale Chest X-ray Dataset

The reliability of machine learning models can be compromised when train...
01/15/2020

CheXplain: Enabling Physicians to Explore and UnderstandData-Driven, AI-Enabled Medical Imaging Analysis

The recent development of data-driven AI promises to automate medical di...