DeepLandscape: Adversarial Modeling of Landscape Video

08/21/2020
by   Elizaveta Logacheva, et al.
0

We build a new model of landscape videos that can be trained on a mixture of static landscape images as well as landscape animations. Our architecture extends StyleGAN model by augmenting it with parts that allow to model dynamic changes in a scene. Once trained, our model can be used to generate realistic time-lapse landscape videos with moving objects and time-of-the-day changes. Furthermore, by fitting the learned models to a static landscape image, the latter can be reenacted in a realistic way. We propose simple but necessary modifications to StyleGAN inversion procedure, which lead to in-domain latent codes and allow to manipulate real images. Quantitative comparisons and user studies suggest that our model produces more compelling animations of given photographs than previously proposed methods. The results of our approach including comparisons with prior art can be seen in supplementary materials and on the project page https://saic-mdal.github.io/deep-landscape

READ FULL TEXT

page 2

page 3

page 5

page 6

page 8

research
09/06/2021

Learning Fine-Grained Motion Embedding for Landscape Animation

In this paper we focus on landscape animation, which aims to generate ti...
research
08/25/2020

Likelihood Landscapes: A Unifying Principle Behind Many Adversarial Defenses

Convolutional Neural Networks have been shown to be vulnerable to advers...
research
04/09/2023

CCLAP: Controllable Chinese Landscape Painting Generation via Latent Diffusion Model

With the development of deep generative models, recent years have seen g...
research
05/08/2023

Learning to Generate Poetic Chinese Landscape Painting with Calligraphy

In this paper, we present a novel system (denoted as Polaca) to generate...
research
06/21/2021

Understanding Object Dynamics for Interactive Image-to-Video Synthesis

What would be the effect of locally poking a static scene? We present an...
research
05/10/2021

Stochastic Image-to-Video Synthesis using cINNs

Video understanding calls for a model to learn the characteristic interp...
research
11/17/2018

Finite Mixture Model of Nonparametric Density Estimation using Sampling Importance Resampling for Persistence Landscape

Considering the creation of persistence landscape on a parametrized curv...

Please sign up or login with your details

Forgot password? Click here to reset