Semantic-Sparse Colorization Network for Deep Exemplar-based Colorization

12/02/2021
by   Yunpeng Bai, et al.
0

Exemplar-based colorization approaches rely on reference image to provide plausible colors for target gray-scale image. The key and difficulty of exemplar-based colorization is to establish an accurate correspondence between these two images. Previous approaches have attempted to construct such a correspondence but are faced with two obstacles. First, using luminance channels for the calculation of correspondence is inaccurate. Second, the dense correspondence they built introduces wrong matching results and increases the computation burden. To address these two problems, we propose Semantic-Sparse Colorization Network (SSCN) to transfer both the global image style and detailed semantic-related colors to the gray-scale image in a coarse-to-fine manner. Our network can perfectly balance the global and local colors while alleviating the ambiguous matching problem. Experiments show that our method outperforms existing methods in both quantitative and qualitative evaluation and achieves state-of-the-art performance.

READ FULL TEXT

page 2

page 4

page 5

page 6

research
11/25/2020

Reference-Based Video Colorization with Spatiotemporal Correspondence

We propose a novel reference-based video colorization framework with spa...
research
04/13/2023

SPColor: Semantic Prior Guided Exemplar-based Image Colorization

Exemplar-based image colorization aims to colorize a target grayscale im...
research
06/18/2023

Referenceless User Controllable Semantic Image Synthesis

Despite recent progress in semantic image synthesis, complete control ov...
research
12/05/2022

BiSTNet: Semantic Image Prior Guided Bidirectional Temporal Feature Fusion for Deep Exemplar-based Video Colorization

How to effectively explore the colors of reference exemplars and propaga...
research
12/07/2021

SSAT: A Symmetric Semantic-Aware Transformer Network for Makeup Transfer and Removal

Makeup transfer is not only to extract the makeup style of the reference...
research
12/06/2022

Ref-NPR: Reference-Based Non-Photorealistic Radiance Fields

Existing 3D scene stylization methods employ an arbitrary style referenc...
research
11/28/2022

Realtime Fewshot Portrait Stylization Based On Geometric Alignment

This paper presents a portrait stylization method designed for real-time...

Please sign up or login with your details

Forgot password? Click here to reset