Speak2Label: Using Domain Knowledge for Creating a Large Scale Driver Gaze Zone Estimation Dataset

04/13/2020
by   Shreya Ghosh, et al.
19

Labelling of human behavior analysis data is a complex and time consuming task. In this paper, a fully automatic technique for labelling an image based gaze behavior dataset for driver gaze zone estimation is proposed. Domain knowledge can be added to the data recording paradigm and later labels can be generated in an automatic manner using speech to text conversion. In order to remove the noise in STT due to different ethnicity, the speech frequency and energy are analysed. The resultant Driver Gaze in the Wild DGW dataset contains 586 recordings, captured during different times of the day including evening. The large scale dataset contains 338 subjects with an age range of 18-63 years. As the data is recorded in different lighting conditions, an illumination robust layer is proposed in the Convolutional Neural Network (CNN). The extensive experiments show the variance in the database resembling real-world conditions and the effectiveness of the proposed CNN pipeline. The proposed network is also fine-tuned for the eye gaze prediction task, which shows the discriminativeness of the representation learnt by our network on the proposed DGW dataset.

READ FULL TEXT

page 1

page 2

page 4

page 5

page 7

page 10

page 12

research
04/04/2019

Unsupervised Learning of Eye Gaze Representation from the Web

Automatic eye gaze estimation has interested researchers for a while now...
research
04/11/2015

Appearance-Based Gaze Estimation in the Wild

Appearance-based gaze estimation is believed to work well in real-world ...
research
02/06/2020

Driver Gaze Estimation in the Real World: Overcoming the Eyeglass Challenge

A driver's gaze is critical for determining the driver's attention level...
research
11/24/2016

Learning Where to Attend Like a Human Driver

Despite the advent of autonomous cars, it's likely - at least in the nea...
research
02/08/2018

Driver Gaze Zone Estimation using Convolutional Neural Networks: A General Framework and Ablative Analysis

Driver gaze has been shown to be an excellent surrogate for driver atten...
research
07/27/2018

ESCaF: Pupil Centre Localization Algorithm with Candidate Filtering

Algorithms for accurate localization of pupil centre is essential for ga...
research
12/23/2020

Estimation of Driver's Gaze Region from Head Position and Orientation using Probabilistic Confidence Regions

A smart vehicle should be able to understand human behavior and predict ...

Please sign up or login with your details

Forgot password? Click here to reset