STALP: Style Transfer with Auxiliary Limited Pairing

10/20/2021
by   David Futschik, et al.
0

We present an approach to example-based stylization of images that uses a single pair of a source image and its stylized counterpart. We demonstrate how to train an image translation network that can perform real-time semantically meaningful style transfer to a set of target images with similar content as the source image. A key added value of our approach is that it considers also consistency of target images during training. Although those have no stylized counterparts, we constrain the translation to keep the statistics of neural responses compatible with those extracted from the stylized source. In contrast to concurrent techniques that use a similar input, our approach better preserves important visual characteristics of the source style and can deliver temporally stable results without the need to explicitly handle temporal consistency. We demonstrate its practical utility on various applications including video stylization, style transfer to panoramas, faces, and 3D models.

READ FULL TEXT

page 1

page 4

page 5

page 6

page 9

page 10

page 11

page 12

research
12/11/2020

DeepObjStyle: Deep Object-based Photo Style Transfer

One of the major challenges of style transfer is the appropriate image f...
research
07/09/2018

StyleBlit: Fast Example-Based Stylization with Local Guidance

We present StyleBlit---an efficient example-based style transfer algorit...
research
04/29/2020

Interactive Video Stylization Using Few-Shot Patch-Based Training

In this paper, we present a learning-based method to the keyframe-based ...
research
12/10/2019

HyperCon: Image-To-Video Model Transfer for Video-To-Video Translation Tasks

Video-to-video translation for super-resolution, inpainting, style trans...
research
11/21/2018

Adjustable Real-time Style Transfer

Artistic style transfer is the problem of synthesizing an image with con...
research
07/06/2022

DCT-Net: Domain-Calibrated Translation for Portrait Stylization

This paper introduces DCT-Net, a novel image translation architecture fo...
research
10/29/2021

Learning Co-segmentation by Segment Swapping for Retrieval and Discovery

The goal of this work is to efficiently identify visually similar patter...

Please sign up or login with your details

Forgot password? Click here to reset