Single Source One Shot Reenactment using Weighted motion From Paired Feature Points

04/07/2021
by   Soumya Tripathy, et al.
0

Image reenactment is a task where the target object in the source image imitates the motion represented in the driving image. One of the most common reenactment tasks is face image animation. The major challenge in the current face reenactment approaches is to distinguish between facial motion and identity. For this reason, the previous models struggle to produce high-quality animations if the driving and source identities are different (cross-person reenactment). We propose a new (face) reenactment model that learns shape-independent motion features in a self-supervised setup. The motion is represented using a set of paired feature points extracted from the source and driving images simultaneously. The model is generalised to multiple reenactment tasks including faces and non-face objects using only a single source image. The extensive experiments show that the model faithfully transfers the driving motion to the source while retaining the source identity intact.

READ FULL TEXT

page 2

page 4

page 5

page 7

page 8

research
11/09/2020

FACEGAN: Facial Attribute Controllable rEenactment GAN

The face reenactment is a popular facial animation method where the pers...
research
11/23/2022

Semantic-aware One-shot Face Re-enactment with Dense Correspondence Estimation

One-shot face re-enactment is a challenging task due to the identity mis...
research
08/18/2020

Mesh Guided One-shot Face Reenactment using Graph Convolutional Networks

Face reenactment aims to animate a source face image to a different pose...
research
03/27/2022

Thin-Plate Spline Motion Model for Image Animation

Image animation brings life to the static object in the source image acc...
research
07/17/2020

Cross-Identity Motion Transfer for Arbitrary Objects through Pose-Attentive Video Reassembling

We propose an attention-based networks for transferring motions between ...
research
10/04/2022

Implicit Warping for Animation with Image Sets

We present a new implicit warping framework for image animation using se...
research
03/08/2018

Motion deblurring of faces

Face analysis is a core part of computer vision, in which remarkable pro...

Please sign up or login with your details

Forgot password? Click here to reset