Learning to Detect Head Movement in Unconstrained Remote Gaze Estimation in the Wild

04/07/2020
by   Zhecan Wang, et al.
4

Unconstrained remote gaze estimation remains challenging mostly due to its vulnerability to the large variability in head-pose. Prior solutions struggle to maintain reliable accuracy in unconstrained remote gaze tracking. Among them, appearance-based solutions demonstrate tremendous potential in improving gaze accuracy. However, existing works still suffer from head movement and are not robust enough to handle real-world scenarios. Especially most of them study gaze estimation under controlled scenarios where the collected datasets often cover limited ranges of both head-pose and gaze which introduces further bias. In this paper, we propose novel end-to-end appearance-based gaze estimation methods that could more robustly incorporate different levels of head-pose representations into gaze estimation. Our method could generalize to real-world scenarios with low image quality, different lightings and scenarios where direct head-pose information is not available. To better demonstrate the advantage of our methods, we further propose a new benchmark dataset with the most rich distribution of head-gaze combination reflecting real-world scenarios. Extensive evaluations on several public datasets and our own dataset demonstrate that our method consistently outperforms the state-of-the-art by a significant margin.

READ FULL TEXT

page 3

page 5

research
04/23/2018

Light-weight Head Pose Invariant Gaze Tracking

Unconstrained remote gaze tracking using off-the-shelf cameras is a chal...
research
02/05/2023

Towards Precision in Appearance-based Gaze Estimation in the Wild

Appearance-based gaze estimation systems have shown great progress recen...
research
07/31/2020

ETH-XGaze: A Large Scale Dataset for Gaze Estimation under Extreme Head Pose and Gaze Variation

Gaze estimation is a fundamental task in many applications of computer v...
research
01/25/2020

GEDDnet: A Network for Gaze Estimation with Dilation and Decomposition

Appearance-based gaze estimation from RGB images provides relatively unc...
research
04/26/2018

Detection-Tracking for Efficient Person Analysis: The DetTA Pipeline

In the past decade many robots were deployed in the wild, and people det...
research
09/11/2023

Angle Range and Identity Similarity Enhanced Gaze and Head Redirection based on Synthetic data

In this paper, we propose a method for improving the angular accuracy an...
research
12/13/2021

Self-Paced Deep Regression Forests with Consideration on Ranking Fairness

Deep discriminative models (DDMs), such as deep regression forests, deep...

Please sign up or login with your details

Forgot password? Click here to reset