AlphaNet: An Attention Guided Deep Network for Automatic Image Matting

03/07/2020
by   Rishab Sharma, et al.
0

In this paper, we propose an end to end solution for image matting i.e high-precision extraction of foreground objects from natural images. Image matting and background detection can be achieved easily through chroma keying in a studio setting when the background is either pure green or blue. Nonetheless, image matting in natural scenes with complex and uneven depth backgrounds remains a tedious task that requires human intervention. To achieve complete automatic foreground extraction in natural scenes, we propose a method that assimilates semantic segmentation and deep image matting processes into a single network to generate detailed semantic mattes for image composition task. The contribution of our proposed method is two-fold, firstly it can be interpreted as a fully automated semantic image matting method and secondly as a refinement of existing semantic segmentation models. We propose a novel model architecture as a combination of segmentation and matting that unifies the function of upsampling and downsampling operators with the notion of attention. As shown in our work, attention guided downsampling and upsampling can extract high-quality boundary details, unlike other normal downsampling and upsampling techniques. For achieving the same, we utilized an attention guided encoder-decoder framework which does unsupervised learning for generating an attention map adaptively from the data to serve and direct the upsampling and downsampling operators. We also construct a fashion e-commerce focused dataset with high-quality alpha mattes to facilitate the training and evaluation for image matting.

READ FULL TEXT

page 1

page 4

page 6

page 7

research
04/10/2019

Instance Segmentation based Semantic Matting for Compositing Applications

Image compositing is a key step in film making and image editing that ai...
research
08/16/2022

SGM-Net: Semantic Guided Matting Net

Human matting refers to extracting human parts from natural images with ...
research
10/30/2020

End-to-end Animal Image Matting

Extracting accurate foreground animals from natural animal images benefi...
research
08/02/2019

Indices Matter: Learning to Index for Deep Image Matting

We show that existing upsampling operators can be unified with the notio...
research
09/05/2018

Semantic Human Matting

Human matting, high quality extraction of humans from natural images, is...
research
04/20/2022

PP-Matting: High-Accuracy Natural Image Matting

Natural image matting is a fundamental and challenging computer vision t...
research
04/10/2020

Boosting Semantic Human Matting with Coarse Annotations

Semantic human matting aims to estimate the per-pixel opacity of the for...

Please sign up or login with your details

Forgot password? Click here to reset