Generalizing Gaze Estimation with Outlier-guided Collaborative Adaptation

07/29/2021
by   Yunfei Liu, et al.
0

Deep neural networks have significantly improved appearance-based gaze estimation accuracy. However, it still suffers from unsatisfactory performance when generalizing the trained model to new domains, e.g., unseen environments or persons. In this paper, we propose a plug-and-play gaze adaptation framework (PnP-GA), which is an ensemble of networks that learn collaboratively with the guidance of outliers. Since our proposed framework does not require ground-truth labels in the target domain, the existing gaze estimation networks can be directly plugged into PnP-GA and generalize the algorithms to new domains. We test PnP-GA on four gaze domain adaptation tasks, ETH-to-MPII, ETH-to-EyeDiap, Gaze360-to-MPII, and Gaze360-to-EyeDiap. The experimental results demonstrate that the PnP-GA framework achieves considerable performance improvements of 36.9 proposed framework also outperforms the state-of-the-art domain adaptation approaches on gaze domain adaptation tasks.

READ FULL TEXT

page 3

page 4

page 8

research
10/05/2022

Jitter Does Matter: Adapting Gaze Estimation to New Domains

Deep neural networks have demonstrated superior performance on appearanc...
research
11/15/2020

Domain Adaptation Gaze Estimation by Embedding with Prediction Consistency

Gaze is the essential manifestation of human attention. In recent years,...
research
06/21/2021

CUDA-GR: Controllable Unsupervised Domain Adaptation for Gaze Redirection

The aim of gaze redirection is to manipulate the gaze in an image to the...
research
09/05/2023

PCFGaze: Physics-Consistent Feature for Appearance-based Gaze Estimation

Although recent deep learning based gaze estimation approaches have achi...
research
04/24/2019

Improving Few-Shot User-Specific Gaze Adaptation via Gaze Redirection Synthesis

As an indicator of human attention gaze is a subtle behavioral cue which...
research
07/23/2019

GA-DAN: Geometry-Aware Domain Adaptation Network for Scene Text Detection and Recognition

Recent adversarial learning research has achieved very impressive progre...
research
04/15/2020

DeeSCo: Deep heterogeneous ensemble with Stochastic Combinatory loss for gaze estimation

From medical research to gaming applications, gaze estimation is becomin...

Please sign up or login with your details

Forgot password? Click here to reset