Deep Image Harmonization with Globally Guided Feature Transformation and Relation Distillation

08/01/2023
by   Li Niu, et al.
0

Given a composite image, image harmonization aims to adjust the foreground illumination to be consistent with background. Previous methods have explored transforming foreground features to achieve competitive performance. In this work, we show that using global information to guide foreground feature transformation could achieve significant improvement. Besides, we propose to transfer the foreground-background relation from real images to composite images, which can provide intermediate supervision for the transformed encoder features. Additionally, considering the drawbacks of existing harmonization datasets, we also contribute a ccHarmony dataset which simulates the natural illumination variation. Extensive experiments on iHarmony4 and our contributed dataset demonstrate the superiority of our method. Our ccHarmony dataset is released at https://github.com/bcmi/Image-Harmonization-Dataset-ccHarmony.

READ FULL TEXT

page 5

page 7

page 8

page 11

page 12

page 13

page 14

page 15

research
08/09/2023

Foreground Object Search by Distilling Composite Image Feature

Foreground object search (FOS) aims to find compatible foreground object...
research
04/10/2022

Image Harmonization by Matching Regional References

To achieve visual consistency in composite images, recent image harmoniz...
research
03/20/2022

NeuralReshaper: Single-image Human-body Retouching with Deep Neural Networks

In this paper, we present NeuralReshaper, a novel method for semantic re...
research
05/19/2023

Learning Global-aware Kernel for Image Harmonization

Image harmonization aims to solve the visual inconsistency problem in co...
research
08/01/2023

Deep Image Harmonization with Learnable Augmentation

The goal of image harmonization is adjusting the foreground appearance i...
research
07/06/2022

Spatial Transformation for Image Composition via Correspondence Learning

When using cut-and-paste to acquire a composite image, the geometry inco...
research
04/29/2022

SCS-Co: Self-Consistent Style Contrastive Learning for Image Harmonization

Image harmonization aims to achieve visual consistency in composite imag...

Please sign up or login with your details

Forgot password? Click here to reset