Gaze Estimation Approach Using Deep Differential Residual Network

08/08/2022
by   Longzhao Huang, et al.
4

Gaze estimation, which is a method to determine where a person is looking at given the person's full face, is a valuable clue for understanding human intention. Similarly to other domains of computer vision, deep learning (DL) methods have gained recognition in the gaze estimation domain. However, there are still gaze calibration problems in the gaze estimation domain, thus preventing existing methods from further improving the performances. An effective solution is to directly predict the difference information of two human eyes, such as the differential network (Diff-Nn). However, this solution results in a loss of accuracy when using only one inference image. We propose a differential residual model (DRNet) combined with a new loss function to make use of the difference information of two eye images. We treat the difference information as auxiliary information. We assess the proposed model (DRNet) mainly using two public datasets (1) MpiiGaze and (2) Eyediap. Considering only the eye features, DRNet outperforms the state-of-the-art gaze estimation methods with angular-error of 4.57 and 6.14 using MpiiGaze and Eyediap datasets, respectively. Furthermore, the experimental results also demonstrate that DRNet is extremely robust to noise images.

READ FULL TEXT

page 3

page 5

page 7

research
04/20/2019

A Differential Approach for Gaze Estimation

Non-invasive gaze estimation methods usually regress gaze directions dir...
research
04/26/2021

Appearance-based Gaze Estimation With Deep Learning: A Review and Benchmark

Gaze estimation reveals where a person is looking. It is an important cl...
research
01/18/2021

LNSMM: Eye Gaze Estimation With Local Network Share Multiview Multitask

Eye gaze estimation has become increasingly significant in computer visi...
research
12/08/2014

When Computer Vision Gazes at Cognition

Joint attention is a core, early-developing form of social interaction. ...
research
03/17/2023

Confidence-aware 3D Gaze Estimation and Evaluation Metric

Deep learning appearance-based 3D gaze estimation is gaining popularity ...
research
01/01/2020

A Coarse-to-Fine Adaptive Network for Appearance-Based Gaze Estimation

Human gaze is essential for various appealing applications. Aiming at mo...
research
10/31/2019

A Self Validation Network for Object-Level Human Attention Estimation

Due to the foveated nature of the human vision system, people can focus ...

Please sign up or login with your details

Forgot password? Click here to reset