Temporally Consistent Semantic Video Editing

06/21/2022
by   Yiran Xu, et al.
1

Generative adversarial networks (GANs) have demonstrated impressive image generation quality and semantic editing capability of real images, e.g., changing object classes, modifying attributes, or transferring styles. However, applying these GAN-based editing to a video independently for each frame inevitably results in temporal flickering artifacts. We present a simple yet effective method to facilitate temporally coherent video editing. Our core idea is to minimize the temporal photometric inconsistency by optimizing both the latent code and the pre-trained generator. We evaluate the quality of our editing on different domains and GAN inversion techniques and show favorable results against the baselines.

READ FULL TEXT

page 1

page 5

page 7

page 9

page 10

page 11

page 12

page 14

research
02/09/2023

In-N-Out: Face Video Inversion and Editing with Volumetric Decomposition

3D-aware GANs offer new capabilities for creative content editing, such ...
research
08/28/2023

MagicEdit: High-Fidelity and Temporally Coherent Video Editing

In this report, we present MagicEdit, a surprisingly simple yet effectiv...
research
05/31/2023

Control4D: Dynamic Portrait Editing by Learning 4D GAN from 2D Diffusion-based Editor

Recent years have witnessed considerable achievements in editing images ...
research
03/28/2023

VIVE3D: Viewpoint-Independent Video Editing using 3D-Aware GANs

We introduce VIVE3D, a novel approach that extends the capabilities of i...
research
10/12/2021

Real Image Inversion via Segments

In this short report, we present a simple, yet effective approach to edi...
research
01/31/2022

Third Time's the Charm? Image and Video Editing with StyleGAN3

StyleGAN is arguably one of the most intriguing and well-studied generat...
research
02/08/2022

Self-Conditioned Generative Adversarial Networks for Image Editing

Generative Adversarial Networks (GANs) are susceptible to bias, learned ...

Please sign up or login with your details

Forgot password? Click here to reset