Real-Time User-Guided Image Colorization with Learned Deep Priors

05/08/2017
by   Richard Zhang, et al.
0

We propose a deep learning approach for user-guided image colorization. The system directly maps a grayscale image, along with sparse, local user "hints" to an output colorization with a Convolutional Neural Network (CNN). Rather than using hand-defined rules, the network propagates user edits by fusing low-level cues along with high-level semantic information, learned from large-scale data. We train on a million images, with simulated user inputs. To guide the user towards efficient input selection, the system recommends likely colors based on the input image and current user inputs. The colorization is performed in a single feed-forward pass, enabling real-time use. Even with randomly simulated user inputs, we show that the proposed system helps novice users quickly create realistic colorizations, and offers large improvements in colorization quality with just a minute of use. In addition, we demonstrate that the framework can incorporate other user "hints" to the desired colorization, showing an application to color histogram transfer. Our code and models are available at https://richzhang.github.io/ideepcolor.

READ FULL TEXT

page 1

page 4

page 6

page 7

page 9

page 10

research
07/17/2018

Deep Exemplar-based Colorization

We propose the first deep learning approach for exemplar-based local col...
research
02/01/2018

Semantic White Balance: Semantic Color Constancy Using Convolutional Neural Network

The goal of the computational color constancy is to preserve the percept...
research
03/11/2018

Deeply supervised neural network with short connections for retinal vessel segmentation

The condition of vessel of the human eye is a fundamental factor for the...
research
12/02/2016

Scribbler: Controlling Deep Image Synthesis with Sketch and Color

Recently, there have been several promising methods to generate realisti...
research
03/23/2021

DeFLOCNet: Deep Image Editing via Flexible Low-level Controls

User-intended visual content fills the hole regions of an input image in...
research
03/28/2016

Colorful Image Colorization

Given a grayscale photograph as input, this paper attacks the problem of...
research
01/27/2018

Interactive Deep Colorization With Simultaneous Global and Local Inputs

Colorization methods using deep neural networks have become a recent tre...

Please sign up or login with your details

Forgot password? Click here to reset