Latent Neural Differential Equations for Video Generation

11/07/2020
by   Cade Gordon, et al.
0

Generative Adversarial Networks have recently shown promise for video generation, building off of the success of image generation while also addressing a new challenge: time. Although time was analyzed in some early work, the literature has not adequately grown with temporal modeling developments. We propose studying the effects of Neural Differential Equations to model the temporal dynamics of video generation. The paradigm of Neural Differential Equations presents many theoretical strengths including the first continuous representation of time within video generation. In order to address the effects of Neural Differential Equations, we will investigate how changes in temporal models affect generated video quality.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/15/2022

DEQGAN: Learning the Loss Function for PINNs with Generative Adversarial Networks

Solutions to differential equations are of significant scientific and en...
research
09/02/2020

Inverse modified differential equations for discovery of dynamics

We introduce inverse modified differential equations (IMDEs) to contribu...
research
06/07/2021

Differentiable Multiple Shooting Layers

We detail a novel class of implicit neural models. Leveraging time-paral...
research
02/21/2020

Stochastic Latent Residual Video Prediction

Designing video prediction models that account for the inherent uncertai...
research
08/06/2021

Quantum Quantile Mechanics: Solving Stochastic Differential Equations for Generating Time-Series

We propose a quantum algorithm for sampling from a solution of stochasti...
research
06/24/2023

Individualized Dosing Dynamics via Neural Eigen Decomposition

Dosing models often use differential equations to model biological dynam...
research
02/25/2021

Orbital dynamics of binary black hole systems can be learned from gravitational wave measurements

We introduce a gravitational waveform inversion strategy that discovers ...

Please sign up or login with your details

Forgot password? Click here to reset