A Coarse-to-Fine Adaptive Network for Appearance-Based Gaze Estimation

01/01/2020
by   Yihua Cheng, et al.
3

Human gaze is essential for various appealing applications. Aiming at more accurate gaze estimation, a series of recent works propose to utilize face and eye images simultaneously. Nevertheless, face and eye images only serve as independent or parallel feature sources in those works, the intrinsic correlation between their features is overlooked. In this paper we make the following contributions: 1) We propose a coarse-to-fine strategy which estimates a basic gaze direction from face image and refines it with corresponding residual predicted from eye images. 2) Guided by the proposed strategy, we design a framework which introduces a bi-gram model to bridge gaze residual and basic gaze direction, and an attention component to adaptively acquire suitable fine-grained feature. 3) Integrating the above innovations, we construct a coarse-to-fine adaptive network named CA-Net and achieve state-of-the-art performances on MPIIGaze and EyeDiap.

READ FULL TEXT

page 5

page 7

research
03/20/2021

Adaptive Feature Fusion Network for Gaze Tracking in Mobile Tablets

Recently, many multi-stream gaze estimation methods have been proposed. ...
research
04/07/2020

MGGR: MultiModal-Guided Gaze Redirection with Coarse-to-Fine Learning

Gaze redirection aims at manipulating a given eye gaze to a desirable di...
research
11/02/2021

Human Attention in Fine-grained Classification

The way humans attend to, process and classify a given image has the pot...
research
08/08/2022

Gaze Estimation Approach Using Deep Differential Residual Network

Gaze estimation, which is a method to determine where a person is lookin...
research
08/25/2020

On estimating gaze by self-attention augmented convolutions

Estimation of 3D gaze is highly relevant to multiple fields, including b...
research
04/12/2002

Fast Hands-free Writing by Gaze Direction

We describe a method for text entry based on inverse arithmetic coding t...
research
05/02/2022

Exposing Deepfake Face Forgeries with Guided Residuals

Residual-domain feature is very useful for Deepfake detection because it...

Please sign up or login with your details

Forgot password? Click here to reset