Conditional MoCoGAN for Zero-Shot Video Generation

09/13/2021
by   Shun Kimura, et al.
0

We propose a conditional generative adversarial network (GAN) model for zero-shot video generation. In this study, we have explored zero-shot conditional generation setting. In other words, we generate unseen videos from training samples with missing classes. The task is an extension of conditional data generation. The key idea is to learn disentangled representations in the latent space of a GAN. To realize this objective, we base our model on the motion and content decomposed GAN and conditional GAN for image generation. We build the model to find better-disentangled representations and to generate good-quality videos. We demonstrate the effectiveness of our proposed model through experiments on the Weizmann action database and the MUG facial expression database.

READ FULL TEXT

page 3

page 4

research
12/05/2019

Zero-Shot Generation of Human-Object Interaction Videos

Generation of videos of complex scenes is an important open problem in c...
research
07/23/2019

Dynamic Facial Expression Generation on Hilbert Hypersphere with Conditional Wasserstein Generative Adversarial Nets

In this work, we propose a novel approach for generating videos of the s...
research
11/24/2017

Demystifying AlphaGo Zero as AlphaGo GAN

The astonishing success of AlphaGo ZeroSilver_AlphaGo invokes a worldwid...
research
06/16/2021

Disentangling Semantic-to-visual Confusion for Zero-shot Learning

Using generative models to synthesize visual features from semantic dist...
research
08/16/2021

Structure-Aware Feature Generation for Zero-Shot Learning

Zero-Shot Learning (ZSL) targets at recognizing unseen categories by lev...
research
06/05/2023

ZIGNeRF: Zero-shot 3D Scene Representation with Invertible Generative Neural Radiance Fields

Generative Neural Radiance Fields (NeRFs) have demonstrated remarkable p...
research
05/10/2023

Sketching the Future (STF): Applying Conditional Control Techniques to Text-to-Video Models

The proliferation of video content demands efficient and flexible neural...

Please sign up or login with your details

Forgot password? Click here to reset