BigColor: Colorization using a Generative Color Prior for Natural Images

by   Geonung Kim, et al.

For realistic and vivid colorization, generative priors have recently been exploited. However, such generative priors often fail for in-the-wild complex images due to their limited representation space. In this paper, we propose BigColor, a novel colorization approach that provides vivid colorization for diverse in-the-wild images with complex structures. While previous generative priors are trained to synthesize both image structures and colors, we learn a generative color prior to focus on color synthesis given the spatial structure of an image. In this way, we reduce the burden of synthesizing image structures from the generative prior and expand its representation space to cover diverse images. To this end, we propose a BigGAN-inspired encoder-generator network that uses a spatial feature map instead of a spatially-flattened BigGAN latent code, resulting in an enlarged representation space. Our method enables robust colorization for diverse inputs in a single forward pass, supports arbitrary input resolutions, and provides multi-modal colorization results. We demonstrate that BigColor significantly outperforms existing methods especially on in-the-wild images with complex structures.


page 2

page 4

page 6

page 9

page 11

page 12

page 14


Towards Vivid and Diverse Image Colorization with Generative Color Prior

Colorization has attracted increasing interest in recent years. Classic ...

PanoHead: Geometry-Aware 3D Full-Head Synthesis in 360^∘

Synthesis and reconstruction of 3D human head has gained increasing inte...

Learning to Structure an Image with Few Colors

Color and structure are the two pillars that construct an image. Usually...

Learning Image-Adaptive Codebooks for Class-Agnostic Image Restoration

Recent work on discrete generative priors, in the form of codebooks, has...

Exploiting Deep Generative Prior for Versatile Image Restoration and Manipulation

Learning a good image prior is a long-term goal for image restoration an...

Culture-inspired Multi-modal Color Palette Generation and Colorization: A Chinese Youth Subculture Case

Color is an essential component of graphic design, acting not only as a ...

L-CAD: Language-based Colorization with Any-level Descriptions

Language-based colorization produces plausible and visually pleasing col...

Please sign up or login with your details

Forgot password? Click here to reset