Joint Bilateral Learning for Real-time Universal Photorealistic Style Transfer

04/23/2020
by   Xide Xia, et al.
7

Photorealistic style transfer is the task of transferring the artistic style of an image onto a content target, producing a result that is plausibly taken with a camera. Recent approaches, based on deep neural networks, produce impressive results but are either too slow to run at practical resolutions, or still contain objectionable artifacts. We propose a new end-to-end model for photorealistic style transfer that is both fast and inherently generates photorealistic results. The core of our approach is a feed-forward neural network that learns local edge-aware affine transforms that automatically obey the photorealism constraint. When trained on a diverse set of images and a variety of styles, our model can robustly apply style transfer to an arbitrary pair of input images. Compared to the state of the art, our method produces visually superior results and is three orders of magnitude faster, enabling real-time performance at 4K on a mobile phone. We validate our method with ablation and user studies.

READ FULL TEXT

page 1

page 3

page 5

page 9

page 10

page 11

page 13

page 14

research
06/03/2018

A Comprehensive Comparison between Neural Style Transfer and Universal Style Transfer

Style transfer aims to transfer arbitrary visual styles to content image...
research
03/20/2017

Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization

Gatys et al. recently introduced a neural algorithm that renders a conte...
research
11/21/2018

Adjustable Real-time Style Transfer

Artistic style transfer is the problem of synthesizing an image with con...
research
07/09/2018

StyleBlit: Fast Example-Based Stylization with Local Guidance

We present StyleBlit---an efficient example-based style transfer algorit...
research
03/27/2017

Coherent Online Video Style Transfer

Training a feed-forward network for fast neural style transfer of images...
research
11/12/2015

Automatic Content-Aware Color and Tone Stylization

We introduce a new technique that automatically generates diverse, visua...
research
12/02/2021

StyleMesh: Style Transfer for Indoor 3D Scene Reconstructions

We apply style transfer on mesh reconstructions of indoor scenes. This e...

Please sign up or login with your details

Forgot password? Click here to reset