MagicEdit: High-Fidelity and Temporally Coherent Video Editing

08/28/2023
by   Jun Hao Liew, et al.
0

In this report, we present MagicEdit, a surprisingly simple yet effective solution to the text-guided video editing task. We found that high-fidelity and temporally coherent video-to-video translation can be achieved by explicitly disentangling the learning of content, structure and motion signals during training. This is in contradict to most existing methods which attempt to jointly model both the appearance and temporal representation within a single framework, which we argue, would lead to degradation in per-frame quality. Despite its simplicity, we show that MagicEdit supports various downstream video editing tasks, including video stylization, local editing, video-MagicMix and video outpainting.

READ FULL TEXT

page 1

page 4

page 5

page 6

page 7

page 8

research
06/21/2022

Temporally Consistent Semantic Video Editing

Generative adversarial networks (GANs) have demonstrated impressive imag...
research
03/09/2023

CoralStyleCLIP: Co-optimized Region and Layer Selection for Image Editing

Edit fidelity is a significant issue in open-world controllable generati...
research
07/17/2019

Towards Data-Driven Automatic Video Editing

Automatic video editing involving at least the steps of selecting the mo...
research
05/31/2023

Control4D: Dynamic Portrait Editing by Learning 4D GAN from 2D Diffusion-based Editor

Recent years have witnessed considerable achievements in editing images ...
research
02/02/2023

Dreamix: Video Diffusion Models are General Video Editors

Text-driven image and video diffusion models have recently achieved unpr...
research
03/28/2023

VIVE3D: Viewpoint-Independent Video Editing using 3D-Aware GANs

We introduce VIVE3D, a novel approach that extends the capabilities of i...
research
12/20/2020

High-Fidelity Neural Human Motion Transfer from Monocular Video

Video-based human motion transfer creates video animations of humans fol...

Please sign up or login with your details

Forgot password? Click here to reset