Deep Learning-based Eye-Tracking Analysis for Diagnosis of Alzheimer's Disease Using 3D Comprehensive Visual Stimuli

03/13/2023
by   Fangyu Zuo, et al.
0

Alzheimer's Disease (AD) causes a continuous decline in memory, thinking, and judgment. Traditional diagnoses are usually based on clinical experience, which is limited by some realistic factors. In this paper, we focus on exploiting deep learning techniques to diagnose AD based on eye-tracking behaviors. Visual attention, as typical eye-tracking behavior, is of great clinical value to detect cognitive abnormalities in AD patients. To better analyze the differences in visual attention between AD patients and normals, we first conduct a 3D comprehensive visual task on a non-invasive eye-tracking system to collect visual attention heatmaps. We then propose a multi-layered comparison convolution neural network (MC-CNN) to distinguish the visual attention differences between AD patients and normals. In MC-CNN, the multi-layered representations of heatmaps are obtained by hierarchical convolution to better encode eye-movement behaviors, which are further integrated into a distance vector to benefit the comprehensive visual task. Extensive experimental results on the collected dataset demonstrate that MC-CNN achieves consistent validity in classifying AD patients and normals with eye-tracking data.

READ FULL TEXT

page 1

page 3

page 4

research
08/10/2023

Attention-based 3D CNN with Multi-layer Features for Alzheimer's Disease Diagnosis using Brain Images

Structural MRI and PET imaging play an important role in the diagnosis o...
research
02/02/2017

Eye-Movement behavior identification for AD diagnosis

In the present work, we develop a deep-learning approach for differentia...
research
11/14/2021

An Assessment of the Eye Tracking Signal Quality Captured in the HoloLens 2

We present an analysis of the eye tracking signal quality of the HoloLen...
research
06/05/2019

The Stanford Acuity Test: A Probabilistic Approach for Precise Visual Acuity Testing

Chart-based visual acuity measurements are used by billions of people to...
research
08/10/2023

More Than Meets the Eye: Analyzing Anesthesiologists' Visual Attention in the Operating Room Using Deep Learning Models

Patient's vital signs, which are displayed on monitors, make the anesthe...
research
04/11/2023

MC-ViViT: Multi-branch Classifier-ViViT to Detect Mild Cognitive Impairment in Older Adults using Facial Videos

Deep machine learning models including Convolutional Neural Networks (CN...

Please sign up or login with your details

Forgot password? Click here to reset