Joint Intensity-Gradient Guided Generative Modeling for Colorization

12/28/2020
by   Kai Hong, et al.
5

This paper proposes an iterative generative model for solving the automatic colorization problem. Although previous researches have shown the capability to generate plausible color, the edge color overflow and the requirement of the reference images still exist. The starting point of the unsupervised learning in this study is the observation that the gradient map possesses latent information of the image. Therefore, the inference process of the generative modeling is conducted in joint intensity-gradient domain. Specifically, a set of intensity-gradient formed high-dimensional tensors, as the network input, are used to train a powerful noise conditional score network at the training phase. Furthermore, the joint intensity-gradient constraint in data-fidelity term is proposed to limit the degree of freedom within generative model at the iterative colorization stage, and it is conducive to edge-preserving. Extensive experiments demonstrated that the system outperformed state-of-the-art methods whether in quantitative comparisons or user study.

READ FULL TEXT

page 1

page 2

page 5

page 8

page 9

page 10

page 11

page 12

research
08/14/2021

High-dimensional Assisted Generative Model for Color Image Restoration

This work presents an unsupervised deep learning scheme that exploiting ...
research
10/20/2022

PalGAN: Image Colorization with Palette Generative Adversarial Networks

Multimodal ambiguity and color bleeding remain challenging in colorizati...
research
09/27/2020

Iterative Reconstruction for Low-Dose CT using Deep Gradient Priors of Generative Model

Dose reduction in computed tomography (CT) is essential for decreasing r...
research
01/19/2023

Dif-Fusion: Towards High Color Fidelity in Infrared and Visible Image Fusion with Diffusion Models

Color plays an important role in human visual perception, reflecting the...
research
02/22/2017

Counterfactual Control for Free from Generative Models

We introduce a method by which a generative model learning the joint dis...
research
06/03/2015

Celeste: Variational inference for a generative model of astronomical images

We present a new, fully generative model of optical telescope image sets...
research
05/21/2023

Conditional Generative Modeling is All You Need for Marked Temporal Point Processes

Recent advancements in generative modeling have made it possible to gene...

Please sign up or login with your details

Forgot password? Click here to reset