F, B, Alpha Matting

03/17/2020
by   Marco Forte, et al.
0

Cutting out an object and estimating its opacity mask, known as image matting, is a key task in many image editing applications. Deep learning approaches have made significant progress by adapting the encoder-decoder architecture of segmentation networks. However, most of the existing networks only predict the alpha matte and post-processing methods must then be used to recover the original foreground and background colours in the transparent regions. Recently, two methods have shown improved results by also estimating the foreground colours, but at a significant computational and memory cost. In this paper, we propose a low-cost modification to alpha matting networks to also predict the foreground and background colours. We study variations of the training regime and explore a wide range of existing and novel loss functions for the joint prediction. Our method achieves the state of the art performance on the Adobe Composition-1k dataset for alpha matte and composite colour quality. It is also the current best performing method on the alphamatting.com online evaluation.

READ FULL TEXT

page 2

page 9

page 13

research
03/24/2021

Foreground color prediction through inverse compositing

In natural image matting, the goal is to estimate the opacity of the for...
research
09/10/2019

Disentangled Image Matting

Most previous image matting methods require a roughly-specificed trimap ...
research
06/26/2020

Fast Multi-Level Foreground Estimation

Alpha matting aims to estimate the translucency of an object in a given ...
research
06/27/2019

Automatically Extract the Semi-transparent Motion-blurred Hand from a Single Image

When we use video chat, video game, or other video applications, motion-...
research
09/17/2020

Adversarial Image Composition with Auxiliary Illumination

Dealing with the inconsistency between a foreground object and a backgro...
research
05/28/2022

Fast Object Placement Assessment

Object placement assessment (OPA) aims to predict the rationality score ...
research
10/11/2022

AMICO: Amodal Instance Composition

Image composition aims to blend multiple objects to form a harmonized im...

Please sign up or login with your details

Forgot password? Click here to reset