CUDA-GR: Controllable Unsupervised Domain Adaptation for Gaze Redirection

06/21/2021
by   Swati Jindal, et al.
0

The aim of gaze redirection is to manipulate the gaze in an image to the desired direction. However, existing methods are inadequate in generating perceptually reasonable images. Advancement in generative adversarial networks has shown excellent results in generating photo-realistic images. Though, they still lack the ability to provide finer control over different image attributes. To enable such fine-tuned control, one needs to obtain ground truth annotations for the training data which can be very expensive. In this paper, we propose an unsupervised domain adaptation framework, called CUDA-GR, that learns to disentangle gaze representations from the labeled source domain and transfers them to an unlabeled target domain. Our method enables fine-grained control over gaze directions while preserving the appearance information of the person. We show that the generated image-labels pairs in the target domain are effective in knowledge transfer and can boost the performance of the downstream tasks. Extensive experiments on the benchmarking datasets show that the proposed method can outperform state-of-the-art techniques in both quantitative and qualitative evaluation.

READ FULL TEXT

page 7

page 8

page 17

page 18

research
03/31/2023

One-shot Unsupervised Domain Adaptation with Personalized Diffusion Models

Adapting a segmentation model from a labeled source domain to a target d...
research
02/18/2022

Exploring Adversarially Robust Training for Unsupervised Domain Adaptation

Unsupervised Domain Adaptation (UDA) methods aim to transfer knowledge f...
research
11/15/2020

Domain Adaptation Gaze Estimation by Embedding with Prediction Consistency

Gaze is the essential manifestation of human attention. In recent years,...
research
07/29/2021

Generalizing Gaze Estimation with Outlier-guided Collaborative Adaptation

Deep neural networks have significantly improved appearance-based gaze e...
research
04/24/2019

Improving Few-Shot User-Specific Gaze Adaptation via Gaze Redirection Synthesis

As an indicator of human attention gaze is a subtle behavioral cue which...
research
10/09/2020

Controllable Continuous Gaze Redirection

In this work, we present interpGaze, a novel framework for controllable ...
research
05/24/2017

From source to target and back: symmetric bi-directional adaptive GAN

The effectiveness of generative adversarial approaches in producing imag...

Please sign up or login with your details

Forgot password? Click here to reset