Distilling Style from Image Pairs for Global Forward and Inverse Tone Mapping

09/30/2022
by   Aamir Mustafa, et al.
10

Many image enhancement or editing operations, such as forward and inverse tone mapping or color grading, do not have a unique solution, but instead a range of solutions, each representing a different style. Despite this, existing learning-based methods attempt to learn a unique mapping, disregarding this style. In this work, we show that information about the style can be distilled from collections of image pairs and encoded into a 2- or 3-dimensional vector. This gives us not only an efficient representation but also an interpretable latent space for editing the image style. We represent the global color mapping between a pair of images as a custom normalizing flow, conditioned on a polynomial basis of the pixel color. We show that such a network is more effective than PCA or VAE at encoding image style in low-dimensional space and lets us obtain an accuracy close to 40 dB, which is about 7-10 dB improvement over the state-of-the-art methods.

READ FULL TEXT

page 1

page 6

page 9

page 10

page 14

page 15

research
04/03/2022

Forward and backward mapping of image to 2D vector field using fiber bundle color space

We introduce the concept of a fiber bundle color space, which acts accor...
research
11/26/2019

Image2StyleGAN++: How to Edit the Embedded Images?

We propose Image2StyleGAN++, a flexible image editing framework with man...
research
10/05/2022

Inharmonious Region Localization with Auxiliary Style Feature

With the prevalence of image editing techniques, users can create fantas...
research
10/09/2021

Invertible Tone Mapping with Selectable Styles

Although digital cameras can acquire high-dynamic range (HDR) images, th...
research
11/30/2021

SpaceEdit: Learning a Unified Editing Space for Open-Domain Image Editing

Recently, large pretrained models (e.g., BERT, StyleGAN, CLIP) have show...
research
09/03/2019

Topologically-Guided Color Image Enhancement

Enhancement is an important step in post-processing digital images for p...
research
10/17/2022

Reversing Image Signal Processors by Reverse Style Transferring

RAW image datasets are more suitable than the standard RGB image dataset...

Please sign up or login with your details

Forgot password? Click here to reset