Recycle-GAN: Unsupervised Video Retargeting

08/15/2018
by   Aayush Bansal, et al.
2

We introduce a data-driven approach for unsupervised video retargeting that translates content from one domain to another while preserving the style native to a domain, i.e., if contents of John Oliver's speech were to be transferred to Stephen Colbert, then the generated content/speech should be in Stephen Colbert's style. Our approach combines both spatial and temporal information along with adversarial losses for content translation and style preservation. In this work, we first study the advantages of using spatiotemporal constraints over spatial constraints for effective retargeting. We then demonstrate the proposed approach for the problems where information in both space and time matters such as face-to-face translation, flower-to-flower, wind and cloud synthesis, sunrise and sunset.

READ FULL TEXT

page 2

page 3

page 7

page 10

page 11

page 12

page 13

page 14

research
11/14/2017

XGAN: Unsupervised Image-to-Image Translation for Many-to-Many Mappings

Style transfer usually refers to the task of applying color and texture ...
research
04/14/2020

Unsupervised Multimodal Video-to-Video Translation via Self-Supervised Learning

Existing unsupervised video-to-video translation methods fail to produce...
research
03/09/2020

Unsupervised Style and Content Separation by Minimizing Mutual Information for Speech Synthesis

We present a method to generate speech from input text and a style vecto...
research
03/30/2021

Diagonal Attention and Style-based GAN for Content-Style Disentanglement in Image Generation and Translation

One of the important research topics in image generative models is to di...
research
08/02/2021

I2V-GAN: Unpaired Infrared-to-Visible Video Translation

Human vision is often adversely affected by complex environmental factor...
research
03/17/2023

MODIFY: Model-driven Face Stylization without Style Images

Existing face stylization methods always acquire the presence of the tar...
research
06/11/2021

GANs N' Roses: Stable, Controllable, Diverse Image to Image Translation (works for videos too!)

We show how to learn a map that takes a content code, derived from a fac...

Please sign up or login with your details

Forgot password? Click here to reset