Tool- and Domain-Agnostic Parameterization of Style Transfer Effects Leveraging Pretrained Perceptual Metrics

05/19/2021
by   Hiromu Yakura, et al.
0

Current deep learning techniques for style transfer would not be optimal for design support since their "one-shot" transfer does not fit exploratory design processes. To overcome this gap, we propose parametric transcription, which transcribes an end-to-end style transfer effect into parameter values of specific transformations available in an existing content editing tool. With this approach, users can imitate the style of a reference sample in the tool that they are familiar with and thus can easily continue further exploration by manipulating the parameters. To enable this, we introduce a framework that utilizes an existing pretrained model for style transfer to calculate a perceptual style distance to the reference sample and uses black-box optimization to find the parameters that minimize this distance. Our experiments with various third-party tools, such as Instagram and Blender, show that our framework can effectively leverage deep learning techniques for computational design support.

READ FULL TEXT

page 1

page 2

page 3

page 5

page 6

page 7

page 8

page 9

research
03/12/2022

Image Style Transfer: from Artistic to Photorealistic

The rapid advancement of deep learning has significantly boomed the deve...
research
03/14/2020

Interactive Neural Style Transfer with Artists

We present interactive painting processes in which a painter and various...
research
03/22/2017

Deep Photo Style Transfer

This paper introduces a deep-learning approach to photographic style tra...
research
05/28/2018

A Pragmatic AI Approach to Creating Artistic Visual Variations by Neural Style Transfer

On a constant quest for inspiration, designers can become more effective...
research
01/14/2020

ImagineNet: Restyling Apps Using Neural Style Transfer

This paper presents ImagineNet, a tool that uses a novel neural style tr...
research
08/10/2021

Domain-Aware Universal Style Transfer

Style transfer aims to reproduce content images with the styles from ref...
research
08/15/2022

Differentiable WORLD Synthesizer-based Neural Vocoder With Application To End-To-End Audio Style Transfer

In this paper, we propose a differentiable WORLD synthesizer and demonst...

Please sign up or login with your details

Forgot password? Click here to reset