Neural Preset for Color Style Transfer

03/23/2023
by   Zhanghan Ke, et al.
0

In this paper, we present a Neural Preset technique to address the limitations of existing color style transfer methods, including visual artifacts, vast memory requirement, and slow style switching speed. Our method is based on two core designs. First, we propose Deterministic Neural Color Mapping (DNCM) to consistently operate on each pixel via an image-adaptive color mapping matrix, avoiding artifacts and supporting high-resolution inputs with a small memory footprint. Second, we develop a two-stage pipeline by dividing the task into color normalization and stylization, which allows efficient style switching by extracting color styles as presets and reusing them on normalized input images. Due to the unavailability of pairwise datasets, we describe how to train Neural Preset via a self-supervised strategy. Various advantages of Neural Preset over existing methods are demonstrated through comprehensive evaluations. Notably, Neural Preset enables stable 4K color style transfer in real-time without artifacts. Besides, we show that our trained model can naturally support multiple applications without fine-tuning, including low-light image enhancement, underwater image correction, image dehazing, and image harmonization. Project page with demos: https://zhkkke.github.io/NeuralPreset .

READ FULL TEXT

page 1

page 6

page 8

page 10

page 11

page 12

page 13

page 14

research
11/12/2015

Automatic Content-Aware Color and Tone Stylization

We introduce a new technique that automatically generates diverse, visua...
research
03/20/2017

Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization

Gatys et al. recently introduced a neural algorithm that renders a conte...
research
12/24/2022

Meta-Learning for Color-to-Infrared Cross-Modal Style Transfer

Recent object detection models for infrared (IR) imagery are based upon ...
research
08/07/2023

Deterministic Neural Illumination Mapping for Efficient Auto-White Balance Correction

Auto-white balance (AWB) correction is a critical operation in image sig...
research
12/18/2019

Neural Smoke Stylization with Color Transfer

Artistically controlling fluid simulations requires a large amount of ma...
research
12/27/2021

Artwork Style Transfer Model using Deep Learning Approach

Art in general and fine arts, in particular, play a significant role in ...
research
06/19/2019

Artistic Enhancement and Style Transfer of Image Edges using Directional Pseudo-coloring

Computing the gradient of an image is a common step in computer vision p...

Please sign up or login with your details

Forgot password? Click here to reset