Gaze-Net: Appearance-Based Gaze Estimation using Capsule Networks

04/16/2020
by   Bhanuka Mahanama, et al.
0

Recent studies on appearance based gaze estimation indicate the ability of Neural Networks to decode gaze information from facial images encompassing pose information. In this paper, we propose Gaze-Net: A capsule network capable of decoding, representing, and estimating gaze information from ocular region images. We evaluate our proposed system using two publicly available datasets, MPIIGaze (200,000+ images in the wild) and Columbia Gaze (5000+ images of users with 21 gaze directions observed at 5 camera angles/positions). Our model achieves a Mean Absolute Error (MAE) of 2.84^∘ for Combined angle error estimate within dataset for MPI-IGaze dataset. Further, model achieves a MAE of 10.04^∘ for across dataset gaze estimation error for Columbia gaze dataset. Through transfer learning, the error is reduced to 5.9^∘. The results show this approach is promising with implications towards using commodity webcams to develop low-cost multi-user gaze tracking systems.

READ FULL TEXT

page 3

page 4

research
08/20/2023

DVGaze: Dual-View Gaze Estimation

Gaze estimation methods estimate gaze from facial appearance with a sing...
research
03/07/2022

L2CS-Net: Fine-Grained Gaze Estimation in Unconstrained Environments

Human gaze is a crucial cue used in various applications such as human-r...
research
02/05/2023

Towards Precision in Appearance-based Gaze Estimation in the Wild

Appearance-based gaze estimation systems have shown great progress recen...
research
06/26/2022

Customer Gaze Estimation in Retail Using Deep Learning

At present, intelligent computing applications are widely used in differ...
research
09/19/2019

Gaze Estimation for Assisted Living Environments

Effective assisted living environments must be able to perform inference...
research
11/09/2017

Fast camera focus estimation for gaze-based focus control

Many cameras implement auto-focus functionality. However, they typically...
research
11/18/2017

Gazing into the Abyss: Real-time Gaze Estimation

Gaze and face tracking algorithms have traditionally battled a compromis...

Please sign up or login with your details

Forgot password? Click here to reset