Deep Automatic Natural Image Matting

07/15/2021
by   Jizhizi Li, et al.
15

Automatic image matting (AIM) refers to estimating the soft foreground from an arbitrary natural image without any auxiliary input like trimap, which is useful for image editing. Prior methods try to learn semantic features to aid the matting process while being limited to images with salient opaque foregrounds such as humans and animals. In this paper, we investigate the difficulties when extending them to natural images with salient transparent/meticulous foregrounds or non-salient foregrounds. To address the problem, a novel end-to-end matting network is proposed, which can predict a generalized trimap for any image of the above types as a unified semantic representation. Simultaneously, the learned semantic features guide the matting network to focus on the transition areas via an attention mechanism. We also construct a test set AIM-500 that contains 500 diverse natural images covering all types along with manually labeled alpha mattes, making it feasible to benchmark the generalization ability of AIM models. Results of the experiments demonstrate that our network trained on available composite matting datasets outperforms existing methods both objectively and subjectively. The source code and dataset are available at https://github.com/JizhiziLi/AIM.

READ FULL TEXT

page 1

page 3

page 5

page 6

page 8

page 9

page 12

page 13

research
08/05/2022

TransMatting: Enhancing Transparent Objects Matting with Transformers

Image matting refers to predicting the alpha values of unknown foregroun...
research
10/30/2020

End-to-end Animal Image Matting

Extracting accurate foreground animals from natural animal images benefi...
research
11/02/2022

Universal Deep Image Compression via Content-Adaptive Optimization with Adapters

Deep image compression performs better than conventional codecs, such as...
research
03/23/2021

Salient Image Matting

In this paper, we propose an image matting framework called Salient Imag...
research
02/04/2020

Simultaneous Enhancement and Super-Resolution of Underwater Imagery for Improved Visual Perception

In this paper, we introduce and tackle the simultaneous enhancement and ...
research
07/12/2023

SepVAE: a contrastive VAE to separate pathological patterns from healthy ones

Contrastive Analysis VAE (CA-VAEs) is a family of Variational auto-encod...
research
04/11/2023

CamDiff: Camouflage Image Augmentation via Diffusion Model

The burgeoning field of camouflaged object detection (COD) seeks to iden...

Please sign up or login with your details

Forgot password? Click here to reset