HyperNST: Hyper-Networks for Neural Style Transfer

08/09/2022
by   Dan Ruta, et al.
11

We present HyperNST; a neural style transfer (NST) technique for the artistic stylization of images, based on Hyper-networks and the StyleGAN2 architecture. Our contribution is a novel method for inducing style transfer parameterized by a metric space, pre-trained for style-based visual search (SBVS). We show for the first time that such space may be used to drive NST, enabling the application and interpolation of styles from an SBVS system. The technical contribution is a hyper-network that predicts weight updates to a StyleGAN2 pre-trained over a diverse gamut of artistic content (portraits), tailoring the style parameterization on a per-region basis using a semantic map of the facial regions. We show HyperNST to exceed state of the art in content preservation for our stylized content while retaining good style transfer performance.

READ FULL TEXT

page 5

page 10

page 11

page 12

page 13

page 14

research
01/18/2016

Content Aware Neural Style Transfer

This paper presents a content-aware style transfer algorithm for paintin...
research
11/21/2018

Adjustable Real-time Style Transfer

Artistic style transfer is the problem of synthesizing an image with con...
research
04/17/2019

Neural Painters: A learned differentiable constraint for generating brushstroke paintings

We explore neural painters, a generative model for brushstrokes learned ...
research
05/14/2021

Thank you BART! Rewarding Pre-Trained Models Improves Formality Style Transfer

Scarcity of parallel data causes formality style transfer models to have...
research
09/02/2020

Neural Crossbreed: Neural Based Image Metamorphosis

We propose Neural Crossbreed, a feed-forward neural network that can lea...
research
09/22/2022

StyleTime: Style Transfer for Synthetic Time Series Generation

Neural style transfer is a powerful computer vision technique that can i...
research
12/03/2020

MakeupBag: Disentangling Makeup Extraction and Application

This paper introduces MakeupBag, a novel method for automatic makeup sty...

Please sign up or login with your details

Forgot password? Click here to reset