GLStyleNet: Higher Quality Style Transfer Combining Global and Local Pyramid Features

11/18/2018
by   Zhizhong Wang, et al.
0

Recent studies using deep neural networks have shown remarkable success in style transfer especially for artistic and photo-realistic images. However, the approaches using global feature correlations fail to capture small, intricate textures and maintain correct texture scales of the artworks, and the approaches based on local patches are defective on global effect. In this paper, we present a novel feature pyramid fusion neural network, dubbed GLStyleNet, which sufficiently takes into consideration multi-scale and multi-level pyramid features by best aggregating layers across a VGG network, and performs style transfer hierarchically with multiple losses of different scales. Our proposed method retains high-frequency pixel information and low frequency construct information of images from two aspects: loss function constraint and feature fusion. Our approach is not only flexible to adjust the trade-off between content and style, but also controllable between global and local. Compared to state-of-the-art methods, our method can transfer not just large-scale, obvious style cues but also subtle, exquisite ones, and dramatically improves the quality of style transfer. We demonstrate the effectiveness of our approach on portrait style transfer, artistic style transfer, photo-realistic style transfer and Chinese ancient painting style transfer tasks. Experimental results indicate that our unified approach improves image style transfer quality over previous state-of-the-art methods, while also accelerating the whole process in a certain extent. Our code is available at https://github.com/EndyWon/GLStyleNet.

READ FULL TEXT

page 1

page 4

page 5

page 8

research
12/06/2018

Arbitrary Style Transfer with Style-Attentional Networks

Arbitrary style transfer is the problem of synthesizing content image wi...
research
11/17/2016

Multimodal Transfer: A Hierarchical Deep Convolutional Neural Network for Fast Artistic Style Transfer

Transferring artistic styles onto everyday photographs has become an ext...
research
09/18/2020

Face Sketch Synthesis with Style Transfer using Pyramid Column Feature

In this paper, we propose a novel framework based on deep neural network...
research
09/19/2023

Retinex-guided Channel-grouping based Patch Swap for Arbitrary Style Transfer

The basic principle of the patch-matching based style transfer is to sub...
research
12/08/2018

Neural Abstract Style Transfer for Chinese Traditional Painting

Chinese traditional painting is one of the most historical artworks in t...
research
06/25/2021

Interactive Multi-level Stroke Control for Neural Style Transfer

We present StyleTune, a mobile app for interactive multi-level control o...
research
02/19/2018

A Closed-form Solution to Photorealistic Image Stylization

Photorealistic image style transfer algorithms aim at stylizing a conten...

Please sign up or login with your details

Forgot password? Click here to reset