Creation and Validation of a Chest X-Ray Dataset with Eye-tracking and Report Dictation for AI Tool Development

09/15/2020
by   Alexandros Karargyris, et al.
7

We developed a rich dataset of Chest X-Ray (CXR) images to assist investigators in artificial intelligence. The data were collected using an eye tracking system while a radiologist reviewed and reported on 1,083 CXR images. The dataset contains the following aligned data: CXR image, transcribed radiology report text, radiologist's dictation audio and eye gaze coordinates data. We hope this dataset can contribute to various areas of research particularly towards explainable and multimodal deep learning / machine learning methods. Furthermore, investigators in disease classification and localization, automated radiology report generation, and human-machine interaction can benefit from these data. We report deep learning experiments that utilize the attention maps produced by eye gaze dataset to show the potential utility of this data.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 13

page 15

page 16

page 17

page 18

page 19

page 20

10/03/2020

Creation and Validation of a Chest X-Ray Dataset with Eye-tracking and Report Dictation for AI Development

We developed a rich dataset of Chest X-Ray (CXR) images to assist invest...
11/02/2021

Human Attention in Fine-grained Classification

The way humans attend to, process and classify a given image has the pot...
01/30/2021

Matching Representations of Explainable Artificial Intelligence and Eye Gaze for Human-Machine Interaction

Rapid non-verbal communication of task-based stimuli is a challenge in h...
06/05/2020

RIT-Eyes: Rendering of near-eye images for eye-tracking applications

Deep neural networks for video-based eye tracking have demonstrated resi...
10/21/2020

Deep Neural Networks for Low-Cost Eye Tracking

The paper presents a detailed analysis of modern techniques that can be ...
12/22/2021

Comparing radiologists' gaze and saliency maps generated by interpretability methods for chest x-rays

The interpretability of medical image analysis models is considered a ke...
03/13/2020

A Neural Architecture for Detecting Confusion in Eye-tracking Data

Encouraged by the success of deep learning in a variety of domains, we i...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.