A Computer Vision System for Attention Mapping in SLAM based 3D Models

05/06/2013
by   Lucas Paletta, et al.
0

The study of human factors in the frame of interaction studies has been relevant for usability engi-neering and ergonomics for decades. Today, with the advent of wearable eye-tracking and Google glasses, monitoring of human factors will soon become ubiquitous. This work describes a computer vision system that enables pervasive mapping and monitoring of human attention. The key contribu-tion is that our methodology enables full 3D recovery of the gaze pointer, human view frustum and associated human centred measurements directly into an automatically computed 3D model in real-time. We apply RGB-D SLAM and descriptor matching methodologies for the 3D modelling, locali-zation and fully automated annotation of ROIs (regions of interest) within the acquired 3D model. This innovative methodology will open new avenues for attention studies in real world environments, bringing new potential into automated processing for human factors technologies.

READ FULL TEXT

page 2

page 6

research
07/30/2013

An Integrated System for 3D Gaze Recovery and Semantic Analysis of Human Attention

This work describes a computer vision system that enables pervasive mapp...
research
11/20/2022

Decoding Attention from Gaze: A Benchmark Dataset and End-to-End Models

Eye-tracking has potential to provide rich behavioral data about human c...
research
03/05/2018

Building an Integrated Mobile Robotic System for Real-Time Applications in Construction

One of the major challenges of a real-time autonomous robotic system for...
research
07/08/2021

4D Attention: Comprehensive Framework for Spatio-Temporal Gaze Mapping

This study presents a framework for capturing human attention in the spa...
research
10/08/2014

Introducing SLAMBench, a performance and accuracy benchmarking methodology for SLAM

Real-time dense computer vision and SLAM offer great potential for a new...
research
01/30/2019

Real-world Mapping of Gaze Fixations Using Instance Segmentation for Road Construction Safety Applications

Research studies have shown that a large proportion of hazards remain un...
research
09/10/2021

Human-Robot Interaction via a Joint-Initiative Supervised Autonomy (JISA) Framework

In this paper, we propose and validate a Joint-Initiative Supervised Aut...

Please sign up or login with your details

Forgot password? Click here to reset