PCFGaze: Physics-Consistent Feature for Appearance-based Gaze Estimation

09/05/2023
by   Yiwei Bao, et al.
0

Although recent deep learning based gaze estimation approaches have achieved much improvement, we still know little about how gaze features are connected to the physics of gaze. In this paper, we try to answer this question by analyzing the gaze feature manifold. Our analysis revealed the insight that the geodesic distance between gaze features is consistent with the gaze differences between samples. According to this finding, we construct the Physics- Consistent Feature (PCF) in an analytical way, which connects gaze feature to the physical definition of gaze. We further propose the PCFGaze framework that directly optimizes gaze feature space by the guidance of PCF. Experimental results demonstrate that the proposed framework alleviates the overfitting problem and significantly improves cross-domain gaze estimation accuracy without extra training data. The insight of gaze feature has the potential to benefit other regression tasks with physical meanings.

READ FULL TEXT
research
03/24/2021

PureGaze: Purifying Gaze Feature for Generalizable Gaze Estimation

Gaze estimation methods learn eye gaze from facial features. However, am...
research
10/05/2022

Jitter Does Matter: Adapting Gaze Estimation to New Domains

Deep neural networks have demonstrated superior performance on appearanc...
research
07/29/2021

Generalizing Gaze Estimation with Outlier-guided Collaborative Adaptation

Deep neural networks have significantly improved appearance-based gaze e...
research
03/24/2021

Vulnerability of Appearance-based Gaze Estimation

Appearance-based gaze estimation has achieved significant improvement by...
research
09/21/2022

LatentGaze: Cross-Domain Gaze Estimation through Gaze-Aware Analytic Latent Code Manipulation

Although recent gaze estimation methods lay great emphasis on attentivel...
research
11/06/2022

Contrastive Weighted Learning for Near-Infrared Gaze Estimation

Appearance-based gaze estimation has been very successful with the use o...
research
09/08/2023

Unsupervised Gaze-aware Contrastive Learning with Subject-specific Condition

Appearance-based gaze estimation has shown great promise in many applica...

Please sign up or login with your details

Forgot password? Click here to reset