Creation and Validation of a Chest X-Ray Dataset with Eye-tracking and Report Dictation for AI Development

10/03/2020
by   Alexandros Karargyris, et al.
0

We developed a rich dataset of Chest X-Ray (CXR) images to assist investigators in artificial intelligence. The data were collected using an eye tracking system while a radiologist reviewed and reported on 1,083 CXR images. The dataset contains the following aligned data: CXR image, transcribed radiology report text, radiologist's dictation audio and eye gaze coordinates data. We hope this dataset can contribute to various areas of research particularly towards explainable and multimodal deep learning/machine learning methods. Furthermore, investigators in disease classification and localization, automated radiology report generation, and human-machine interaction can benefit from these data. We report deep learning experiments that utilize the attention maps produced by eye gaze dataset to show the potential utility of this data.

READ FULL TEXT

page 1

page 13

page 15

page 16

page 17

page 18

page 19

page 20

research
09/15/2020

Creation and Validation of a Chest X-Ray Dataset with Eye-tracking and Report Dictation for AI Tool Development

We developed a rich dataset of Chest X-Ray (CXR) images to assist invest...
research
07/29/2022

Using Multi-modal Data for Improving Generalizability and Explainability of Disease Classification in Radiology

Traditional datasets for the radiological diagnosis tend to only provide...
research
01/30/2021

Matching Representations of Explainable Artificial Intelligence and Eye Gaze for Human-Machine Interaction

Rapid non-verbal communication of task-based stimuli is a challenge in h...
research
02/06/2023

Integrating Eye-Gaze Data into CXR DL Approaches: A Preliminary study

This paper proposes a novel multimodal DL architecture incorporating med...
research
11/02/2021

Human Attention in Fine-grained Classification

The way humans attend to, process and classify a given image has the pot...
research
06/28/2022

Improving Disease Classification Performance and Explainability of Deep Learning Models in Radiology with Heatmap Generators

As deep learning is widely used in the radiology field, the explainabili...
research
02/15/2022

Gaze-Guided Class Activation Mapping: Leveraging Human Attention for Network Attention in Chest X-rays Classification

The increased availability and accuracy of eye-gaze tracking technology ...

Please sign up or login with your details

Forgot password? Click here to reset