Recurrent CNN for 3D Gaze Estimation using Appearance and Shape Cues

05/08/2018
by   Cristina Palmero, et al.
0

Gaze behavior is an important non-verbal cue in social signal processing and human-computer interaction. In this paper, we tackle the problem of person- and head pose-independent 3D gaze estimation from remote cameras, using a multi-modal recurrent convolutional neural network (CNN). We propose to combine face, eyes region, and face landmarks as individual streams in a CNN to estimate gaze in still images. Then, we exploit the dynamic nature of gaze by feeding the learned features of all the frames in a sequence to a many-to-one recurrent module that predicts the 3D gaze vector of the last frame. Our multi-modal static solution is evaluated on a wide range of head poses and gaze directions, achieving a significant improvement of 14.6 art on EYEDIAP dataset, further improved by 4 included.

READ FULL TEXT
research
11/27/2016

It's Written All Over Your Face: Full-Face Appearance-Based Gaze Estimation

Eye gaze is an important non-verbal cue for human affect analysis. Recen...
research
02/22/2018

An Affordable Bio-Sensing and Activity Tagging Platform for HCI Research

We present a novel multi-modal bio-sensing platform capable of integrati...
research
04/23/2018

Light-weight Head Pose Invariant Gaze Tracking

Unconstrained remote gaze tracking using off-the-shelf cameras is a chal...
research
11/23/2021

HybridGazeNet: Geometric model guided Convolutional Neural Networks for gaze estimation

As a critical cue for understanding human intention, human gaze provides...
research
07/14/2021

Detection of Abnormal Behavior with Self-Supervised Gaze Estimation

Due to the recent outbreak of COVID-19, many classes, exams, and meeting...
research
04/05/2016

Highly accurate gaze estimation using a consumer RGB-depth sensor

Determining the direction in which a person is looking is an important p...
research
03/13/2019

LPM: Learnable Pooling Module for Efficient Full-Face Gaze Estimation

Gaze tracking is an important technology in many domains. Techniques suc...

Please sign up or login with your details

Forgot password? Click here to reset