FLAME: Facial Landmark Heatmap Activated Multimodal Gaze Estimation

10/10/2021
by   Neelabh Sinha, et al.
0

3D gaze estimation is about predicting the line of sight of a person in 3D space. Person-independent models for the same lack precision due to anatomical differences of subjects, whereas person-specific calibrated techniques add strict constraints on scalability. To overcome these issues, we propose a novel technique, Facial Landmark Heatmap Activated Multimodal Gaze Estimation (FLAME), as a way of combining eye anatomical information using eye landmark heatmaps to obtain precise gaze estimation without any person-specific calibration. Our evaluation demonstrates a competitive performance of about 10 improvement on benchmark datasets ColumbiaGaze and EYEDIAP. We also conduct an ablation study to validate our method.

READ FULL TEXT
research
05/06/2019

Few-shot Adaptive Gaze Estimation

Inter-personal anatomical differences limit the accuracy of person-indep...
research
06/27/2021

The Story in Your Eyes: An Individual-difference-aware Model for Cross-person Gaze Estimation

We propose a novel method on refining cross-person gaze prediction task ...
research
06/25/2021

Bayesian Eye Tracking

Model-based eye tracking has been a dominant approach for eye gaze track...
research
07/11/2023

A Modular Multimodal Architecture for Gaze Target Prediction: Application to Privacy-Sensitive Settings

Predicting where a person is looking is a complex task, requiring to und...
research
06/18/2022

Multistream Gaze Estimation with Anatomical Eye Region Isolation by Synthetic to Real Transfer Learning

We propose a novel neural pipeline, MSGazeNet, that learns gaze represen...
research
09/23/2020

Studying Person-Specific Pointing and Gaze Behavior for Multimodal Referencing of Outside Objects from a Moving Vehicle

Hand pointing and eye gaze have been extensively investigated in automot...
research
08/23/2022

Multimodal Across Domains Gaze Target Detection

This paper addresses the gaze target detection problem in single images ...

Please sign up or login with your details

Forgot password? Click here to reset