Controllable Continuous Gaze Redirection

10/09/2020
by   Weihao Xia, et al.
9

In this work, we present interpGaze, a novel framework for controllable gaze redirection that achieves both precise redirection and continuous interpolation. Given two gaze images with different attributes, our goal is to redirect the eye gaze of one person into any gaze direction depicted in the reference image or to generate continuous intermediate results. To accomplish this, we design a model including three cooperative components: an encoder, a controller and a decoder. The encoder maps images into a well-disentangled and hierarchically-organized latent space. The controller adjusts the magnitudes of latent vectors to the desired strength of corresponding attributes by altering a control vector. The decoder converts the desired representations from the attribute space to the image space. To facilitate covering the full space of gaze directions, we introduce a high-quality gaze image dataset with a large range of directions, which also benefits researchers in related areas. Extensive experimental validation and comparisons to several baseline methods show that the proposed interpGaze outperforms state-of-the-art methods in terms of image quality and redirection precision.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 3

page 4

page 5

page 6

page 7

03/29/2019

Photo-realistic Monocular Gaze Redirection using Generative Adversarial Networks

Gaze redirection is the task of changing the gaze to a desired direction...
04/07/2020

MGGR: MultiModal-Guided Gaze Redirection with Coarse-to-Fine Learning

Gaze redirection aims at manipulating a given eye gaze to a desirable di...
08/17/2021

Neural Photofit: Gaze-based Mental Image Reconstruction

We propose a novel method that leverages human fixations to visually dec...
06/21/2021

CUDA-GR: Controllable Unsupervised Domain Adaptation for Gaze Redirection

The aim of gaze redirection is to manipulate the gaze in an image to the...
05/06/2019

Few-shot Adaptive Gaze Estimation

Inter-personal anatomical differences limit the accuracy of person-indep...
09/24/2018

Prioritized Kinematic Control of Joint-Constrained Head-Eye Robots using the Intermediate Value Approach

Existing gaze controllers for head-eye robots can only handle single fix...

Code Repositories

interpGaze

[ACM MM 2020] Code and Data For Controllable Continuous Gaze Redirection.


view repo
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.