It's Written All Over Your Face: Full-Face Appearance-Based Gaze Estimation

11/27/2016
by   Xucong Zhang, et al.
0

Eye gaze is an important non-verbal cue for human affect analysis. Recent gaze estimation work indicated that information from the full face region can benefit performance. Pushing this idea further, we propose an appearance-based method that, in contrast to a long-standing line of work in computer vision, only takes the full face image as input. Our method encodes the face image using a convolutional neural network with spatial weights applied on the feature maps to flexibly suppress or enhance information in different facial regions. Through extensive evaluation, we show that our full-face method significantly outperforms the state of the art for both 2D and 3D gaze estimation, achieving improvements of up to 14.3 EYEDIAP for person-independent 3D gaze estimation. We further show that this improvement is consistent across different illumination conditions and gaze directions and particularly pronounced for the most challenging extreme head poses.

READ FULL TEXT

page 6

page 7

page 8

research
11/24/2017

MPIIGaze: Real-World Dataset and Deep Appearance-Based Gaze Estimation

Learning-based methods are believed to work well for unconstrained gaze ...
research
05/08/2018

Recurrent CNN for 3D Gaze Estimation using Appearance and Shape Cues

Gaze behavior is an important non-verbal cue in social signal processing...
research
05/25/2023

Introducing Explicit Gaze Constraints to Face Swapping

Face swapping combines one face's identity with another face's non-appea...
research
08/18/2023

Investigation of Architectures and Receptive Fields for Appearance-based Gaze Estimation

With the rapid development of deep learning technology in the past decad...
research
03/13/2019

LPM: Learnable Pooling Module for Efficient Full-Face Gaze Estimation

Gaze tracking is an important technology in many domains. Techniques suc...
research
08/17/2021

Neural Photofit: Gaze-based Mental Image Reconstruction

We propose a novel method that leverages human fixations to visually dec...
research
04/05/2016

Highly accurate gaze estimation using a consumer RGB-depth sensor

Determining the direction in which a person is looking is an important p...

Please sign up or login with your details

Forgot password? Click here to reset