Neural Crossbreed: Neural Based Image Metamorphosis

09/02/2020
by   Sanghun Park, et al.
6

We propose Neural Crossbreed, a feed-forward neural network that can learn a semantic change of input images in a latent space to create the morphing effect. Because the network learns a semantic change, a sequence of meaningful intermediate images can be generated without requiring the user to specify explicit correspondences. In addition, the semantic change learning makes it possible to perform the morphing between the images that contain objects with significantly different poses or camera views. Furthermore, just as in conventional morphing techniques, our morphing network can handle shape and appearance transitions separately by disentangling the content and the style transfer for rich usability. We prepare a training dataset for morphing using a pre-trained BigGAN, which generates an intermediate image by interpolating two latent vectors at an intended morphing value. This is the first attempt to address image morphing using a pre-trained generative model in order to learn semantic transformation. The experiments show that Neural Crossbreed produces high quality morphed images, overcoming various limitations associated with conventional approaches. In addition, Neural Crossbreed can be further extended for diverse applications such as multi-image morphing, appearance transfer, and video frame interpolation.

READ FULL TEXT

Authors

page 1

page 7

page 8

page 9

page 10

page 12

page 13

page 16

05/24/2022

Improving the Latent Space of Image Style Transfer

Existing neural style transfer researches have studied to match statisti...
03/20/2017

Multi-style Generative Network for Real-time Transfer

Despite the rapid progress in style transfer, existing approaches using ...
02/25/2020

Style Transfer for Light Field Photography

As light field images continue to increase in use and application, it be...
02/04/2021

Only a Matter of Style: Age Transformation Using a Style-Based Regression Model

The task of age transformation illustrates the change of an individual's...
11/29/2019

Transflow Learning: Repurposing Flow Models Without Retraining

It is well known that deep generative models have a rich latent space, a...
05/14/2018

Replicating Active Appearance Model by Generator Network

A recent Cell paper [Chang and Tsao, 2017] reports an interesting discov...
04/29/2020

Interactive Video Stylization Using Few-Shot Patch-Based Training

In this paper, we present a learning-based method to the keyframe-based ...

Code Repositories

neural_crossbreed

Neural Crossbreed: Neural Based Image Metamorphosis


view repo
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.