Predicting the Driver's Focus of Attention: the DR(eye)VE Project

05/10/2017
by   Andrea Palazzi, et al.
0

In this work we aim to predict the driver's focus of attention. The goal is to estimate what a person would pay attention to while driving, and which part of the scene around the vehicle is more critical for the task. To this end we propose a new computer vision model based on a multi-branch deep architecture that integrates three sources of information: raw video, motion and scene semantics. We also introduce DR(eye)VE, the largest dataset of driving scenes for which eye-tracking annotations are available. This dataset features more than 500,000 registered frames, matching ego-centric views (from glasses worn by drivers) and car-centric views (from roof-mounted camera), further enriched by other sensors measurements. Results highlight that several attention patterns are shared across drivers and can be reproduced to some extent. The indication of which elements in the scene are likely to capture the driver's attention may benefit several applications in the context of human-vehicle interaction and driver attention analysis.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 6

page 8

page 10

page 11

research
04/23/2019

DADA-2000: Can Driving Accident be Predicted by Driver Attention? Analyzed by A Benchmark

Driver attention prediction is currently becoming the focus in safe driv...
research
04/26/2022

Where and What: Driver Attention-based Object Detection

Human drivers use their attentional mechanisms to focus on critical obje...
research
07/08/2022

CoCAtt: A Cognitive-Conditioned Driver Attention Dataset (Supplementary Material)

The task of driver attention prediction has drawn considerable interest ...
research
11/19/2021

CoCAtt: A Cognitive-Conditioned Driver Attention Dataset

The task of driver attention prediction has drawn considerable interest ...
research
11/17/2017

Training a network to attend like human drivers saves it from common but misleading loss functions

We proposed a novel FCN-ConvLSTM model to predict multi-focal human driv...
research
04/20/2022

GIMO: Gaze-Informed Human Motion Prediction in Context

Predicting human motion is critical for assistive robots and AR/VR appli...
research
12/31/2012

The Geant4 Visualisation System - a multi-driver graphics system

From the beginning the Geant4 Visualisation System was designed to suppo...

Please sign up or login with your details

Forgot password? Click here to reset