An Integrated System for 3D Gaze Recovery and Semantic Analysis of Human Attention

07/30/2013
by   Lucas Paletta, et al.
0

This work describes a computer vision system that enables pervasive mapping and monitoring of human attention. The key contribution is that our methodology enables full 3D recovery of the gaze pointer, human view frustum and associated human centered measurements directly into an automatically computed 3D model in real-time. We apply RGB-D SLAM and descriptor matching methodologies for the 3D modeling, localization and fully automated annotation of ROIs (regions of interest) within the acquired 3D model. This innovative methodology will open new avenues for attention studies in real world environments, bringing new potential into automated processing for human factors technologies.

READ FULL TEXT

page 2

page 3

research
05/06/2013

A Computer Vision System for Attention Mapping in SLAM based 3D Models

The study of human factors in the frame of interaction studies has been ...
research
08/18/2016

Seeing with Humans: Gaze-Assisted Neural Image Captioning

Gaze reflects how humans process visual scenes and is therefore increasi...
research
07/27/2018

Towards an Embodied Semantic Fovea: Semantic 3D scene reconstruction from ego-centric eye-tracker videos

Incorporating the physical environment is essential for a complete under...
research
11/20/2022

Decoding Attention from Gaze: A Benchmark Dataset and End-to-End Models

Eye-tracking has potential to provide rich behavioral data about human c...
research
07/08/2021

4D Attention: Comprehensive Framework for Spatio-Temporal Gaze Mapping

This study presents a framework for capturing human attention in the spa...
research
02/15/2022

Gaze-Guided Class Activation Mapping: Leveraging Human Attention for Network Attention in Chest X-rays Classification

The increased availability and accuracy of eye-gaze tracking technology ...
research
11/13/2018

Toward Human-Centered Simulation Modeling for Critical Infrastructure Disaster Recovery Planning

Critical infrastructure is vulnerable to a broad range of hazards. Timel...

Please sign up or login with your details

Forgot password? Click here to reset