VIDM: Video Implicit Diffusion Models

12/01/2022
by   Kangfu Mei, et al.
0

Diffusion models have emerged as a powerful generative method for synthesizing high-quality and diverse set of images. In this paper, we propose a video generation method based on diffusion models, where the effects of motion are modeled in an implicit condition manner, i.e. one can sample plausible video motions according to the latent feature of frames. We improve the quality of the generated videos by proposing multiple strategies such as sampling space truncation, robustness penalty, and positional group normalization. Various experiments are conducted on datasets consisting of videos with different resolutions and different number of frames. Results show that the proposed method outperforms the state-of-the-art generative adversarial network-based methods by a significant margin in terms of FVD scores as well as perceptible visual quality.

READ FULL TEXT

page 1

page 5

page 7

research
02/21/2022

Generating Videos with Dynamics-aware Implicit Generative Adversarial Networks

In the deep learning era, long video generation of high-quality still re...
research
04/23/2023

LaMD: Latent Motion Diffusion for Video Generation

Generating coherent and natural movement is the key challenge in video g...
research
06/29/2022

3D-Aware Video Generation

Generative models have emerged as an essential building block for many i...
research
02/15/2023

Video Probabilistic Diffusion Models in Projected Latent Space

Despite the remarkable progress in deep generative models, synthesizing ...
research
01/08/2021

InMoDeGAN: Interpretable Motion Decomposition Generative Adversarial Network for Video Generation

In this work, we introduce an unconditional video generative model, InMo...
research
06/13/2017

Video Imagination from a Single Image with Transformation Generation

In this work, we focus on a challenging task: synthesizing multiple imag...
research
06/15/2022

Diffusion Models for Video Prediction and Infilling

To predict and anticipate future outcomes or reason about missing inform...

Please sign up or login with your details

Forgot password? Click here to reset