Style Transfer by Relaxed Optimal Transport and Self-Similarity

04/29/2019
by   Nicholas Kolkin, et al.
16

Style transfer algorithms strive to render the content of one image using the style of another. We propose Style Transfer by Relaxed Optimal Transport and Self-Similarity (STROTSS), a new optimization-based style transfer algorithm. We extend our method to allow user-specified point-to-point or region-to-region control over visual similarity between the style image and the output. Such guidance can be used to either achieve a particular visual effect or correct errors made by unconstrained style transfer. In order to quantitatively compare our method to prior work, we conduct a large-scale user study designed to assess the style-content tradeoff across settings in style transfer algorithms. Our results indicate that for any desired level of content preservation, our method provides higher quality stylization than prior work. Code is available at https://github.com/nkolkin13/STROTSS

READ FULL TEXT

page 1

page 2

page 4

page 5

page 6

page 8

page 11

page 12

research
08/29/2021

Non-Parametric Neural Style Transfer

It seems easy to imagine a photograph of the Eiffel Tower painted in the...
research
12/20/2022

QuantArt: Quantizing Image Style Transfer Towards High Visual Fidelity

The mechanism of existing style transfer algorithms is by minimizing a h...
research
08/01/2022

Quality Evaluation of Arbitrary Style Transfer: Subjective Study and Objective Metric

Arbitrary neural style transfer is a vital topic with research value and...
research
03/24/2022

Industrial Style Transfer with Large-scale Geometric Warping and Content Preservation

We propose a novel style transfer method to quickly create a new visual ...
research
05/09/2023

Style-A-Video: Agile Diffusion for Arbitrary Text-based Video Style Transfer

Large-scale text-to-video diffusion models have demonstrated an exceptio...
research
03/25/2022

PCA-Based Knowledge Distillation Towards Lightweight and Content-Style Balanced Photorealistic Style Transfer Models

Photorealistic style transfer entails transferring the style of a refere...
research
06/19/2019

Artistic Enhancement and Style Transfer of Image Edges using Directional Pseudo-coloring

Computing the gradient of an image is a common step in computer vision p...

Please sign up or login with your details

Forgot password? Click here to reset