Interactive Deep Colorization With Simultaneous Global and Local Inputs

01/27/2018
by   Yi Xiao, et al.
0

Colorization methods using deep neural networks have become a recent trend. However, most of them do not allow user inputs, or only allow limited user inputs (only global inputs or only local inputs), to control the output colorful images. The possible reason is that it's difficult to differentiate the influence of different kind of user inputs in network training. To solve this problem, we present a novel deep colorization method, which allows simultaneous global and local inputs to better control the output colorized images. The key step is to design an appropriate loss function that can differentiate the influence of input data, global inputs and local inputs. With this design, our method accepts no inputs, or global inputs, or local inputs, or both global and local inputs, which is not supported in previous deep colorization methods. In addition, we propose a global color theme recommendation system to help users determine global inputs. Experimental results shows that our methods can better control the colorized images and generate state-of-art results.

READ FULL TEXT

page 3

page 5

page 6

page 8

page 9

page 10

page 11

page 12

research
01/05/2023

gRoMA: a Tool for Measuring Deep Neural Networks Global Robustness

Deep neural networks (DNNs) are a state-of-the-art technology, capable o...
research
01/25/2017

Deep Local Video Feature for Action Recognition

We investigate the problem of representing an entire video using CNN fea...
research
06/19/2018

Joint Neural Entity Disambiguation with Output Space Search

In this paper, we present a novel model for entity disambiguation that c...
research
06/21/2023

Verifying Global Neural Network Specifications using Hyperproperties

Current approaches to neural network verification focus on specification...
research
03/14/2022

Simultaneous Learning of the Inputs and Parameters in Neural Collaborative Filtering

Neural network-based collaborative filtering systems focus on designing ...
research
05/08/2017

Real-Time User-Guided Image Colorization with Learned Deep Priors

We propose a deep learning approach for user-guided image colorization. ...
research
10/02/2020

Homography Estimation with Convolutional Neural Networks Under Conditions of Variance

Planar homography estimation is foundational to many computer vision pro...

Please sign up or login with your details

Forgot password? Click here to reset