Depth-aware Neural Style Transfer using Instance Normalization

03/17/2022
by   Eleftherios Ioannou, et al.
0

Neural Style Transfer (NST) is concerned with the artistic stylization of visual media. It can be described as the process of transferring the style of an artistic image onto an ordinary photograph. Recently, a number of studies have considered the enhancement of the depth-preserving capabilities of the NST algorithms to address the undesired effects that occur when the input content images include numerous objects at various depths. Our approach uses a deep residual convolutional network with instance normalization layers that utilizes an advanced depth prediction network to integrate depth preservation as an additional loss function to content and style. We demonstrate results that are effective in retaining the depth and global structure of content images. Three different evaluation processes show that our system is capable of preserving the structure of the stylized results while exhibiting style-capture capabilities and aesthetic qualities comparable or superior to state-of-the-art methods.

READ FULL TEXT

page 5

page 7

page 8

page 9

page 10

page 12

research
07/23/2022

Arbitrary Style Transfer with Structure Enhancement by Combining the Global and Local Loss

Arbitrary style transfer generates an artistic image which combines the ...
research
10/06/2020

Arbitrary Style Transfer using Graph Instance Normalization

Style transfer is the image synthesis task, which applies a style of one...
research
06/03/2019

Depth-Preserving Real-Time Arbitrary Style Transfer

Style transfer is the process of rendering one image with some content i...
research
07/30/2023

InfoStyler: Disentanglement Information Bottleneck for Artistic Style Transfer

Artistic style transfer aims to transfer the style of an artwork to a ph...
research
03/04/2023

Decompose, Adjust, Compose: Effective Normalization by Playing with Frequency for Domain Generalization

Domain generalization (DG) is a principal task to evaluate the robustnes...
research
02/14/2020

Remove Appearance Shift for Ultrasound Image Segmentation via Fast and Universal Style Transfer

Deep Neural Networks (DNNs) suffer from the performance degradation when...
research
08/12/2022

Style Spectroscope: Improve Interpretability and Controllability through Fourier Analysis

Universal style transfer (UST) infuses styles from arbitrary reference i...

Please sign up or login with your details

Forgot password? Click here to reset