Video Content Swapping Using GAN

11/21/2021
by   Tingfung Lau, et al.
10

Video generation is an interesting problem in computer vision. It is quite popular for data augmentation, special effect in move, AR/VR and so on. With the advances of deep learning, many deep generative models have been proposed to solve this task. These deep generative models provide away to utilize all the unlabeled images and videos online, since it can learn deep feature representations with unsupervised manner. These models can also generate different kinds of images, which have great value for visual application. However generating a video would be much more challenging since we need to model not only the appearances of objects in the video but also their temporal motion. In this work, we will break down any frame in the video into content and pose. We first extract the pose information from a video using a pre-trained human pose detection and use a generative model to synthesize the video based on the content code and pose code.

READ FULL TEXT

page 5

page 6

page 7

research
10/17/2018

A Case for Object Compositionality in Deep Generative Models of Images

Deep generative models seek to recover the process with which the observ...
research
12/03/2018

Towards Accurate Generative Models of Video: A New Metric & Challenges

Recent advances in deep generative models have lead to remarkable progre...
research
12/14/2016

Disentangling Space and Time in Video with Hierarchical Variational Auto-encoders

There are many forms of feature information present in video data. Princ...
research
11/05/2022

Disentangling Content and Motion for Text-Based Neural Video Manipulation

Giving machines the ability to imagine possible new objects or scenes fr...
research
06/24/2018

Generative Models for Pose Transfer

We investigate nearest neighbor and generative models for transferring p...
research
05/29/2021

Beyond the Spectrum: Detecting Deepfakes via Re-Synthesis

The rapid advances in deep generative models over the past years have le...
research
03/08/2018

A Deep Generative Model for Disentangled Representations of Sequential Data

We present a VAE architecture for encoding and generating high dimension...

Please sign up or login with your details

Forgot password? Click here to reset