Foreground-aware Semantic Representations for Image Harmonization

06/01/2020
by   Konstantin Sofiiuk, et al.
0

Image harmonization is an important step in photo editing to achieve visual consistency in composite images by adjusting the appearances of foreground to make it compatible with background. Previous approaches to harmonize composites are based on training of encoder-decoder networks from scratch, which makes it challenging for a neural network to learn a high-level representation of objects. We propose a novel architecture to utilize the space of high-level features learned by a pre-trained classification network. We create our models as a combination of existing encoder-decoder architectures and a pre-trained foreground-aware deep high-resolution network. We extensively evaluate the proposed method on existing image harmonization benchmark and set up a new state-of-the-art in terms of MSE and PSNR metrics. The code and trained models are available at <https://github.com/saic-vul/image_harmonization>.

READ FULL TEXT

page 1

page 2

page 7

research
06/05/2021

Region-aware Adaptive Instance Normalization for Image Harmonization

Image composition plays a common but important role in photo editing. To...
research
04/20/2022

PP-Matting: High-Accuracy Natural Image Matting

Natural image matting is a fundamental and challenging computer vision t...
research
03/10/2017

Deep Image Matting

Image matting is a fundamental computer vision problem and has many appl...
research
09/06/2023

Matcha-TTS: A fast TTS architecture with conditional flow matching

We introduce Matcha-TTS, a new encoder-decoder architecture for speedy T...
research
08/04/2018

Learning Multi-scale Features for Foreground Segmentation

Foreground segmentation algorithms aim segmenting moving objects from th...
research
01/07/2018

Foreground Segmentation Using a Triplet Convolutional Neural Network for Multiscale Feature Encoding

A common approach for moving objects segmentation in a scene is to perfo...
research
11/16/2016

Deep Feature Interpolation for Image Content Changes

We propose Deep Feature Interpolation (DFI), a new data-driven baseline ...

Please sign up or login with your details

Forgot password? Click here to reset