Context-Aware Image Matting for Simultaneous Foreground and Alpha Estimation

09/20/2019
by   Qiqi Hou, et al.
1

Natural image matting is an important problem in computer vision and graphics. It is an ill-posed problem when only an input image is available without any external information. While the recent deep learning approaches have shown promising results, they only estimate the alpha matte. This paper presents a context-aware natural image matting method for simultaneous foreground and alpha matte estimation. Our method employs two encoder networks to extract essential information for matting. Particularly, we use a matting encoder to learn local features and a context encoder to obtain more global context information. We concatenate the outputs from these two encoders and feed them into decoder networks to simultaneously estimate the foreground and alpha matte. To train this whole deep neural network, we employ both the standard Laplacian loss and the feature loss: the former helps to achieve high numerical performance while the latter leads to more perceptually plausible results. We also report several data augmentation strategies that greatly improve the network's generalization performance. Our qualitative and quantitative experiments show that our method enables high-quality matting for a single natural image.

READ FULL TEXT

page 2

page 3

page 4

page 7

page 8

research
05/11/2019

Cyclone intensity estimate with context-aware cyclegan

Deep learning approaches to cyclone intensity estimationhave recently sh...
research
01/07/2021

Multi-scale Information Assembly for Image Matting

Image matting is a long-standing problem in computer graphics and vision...
research
03/24/2021

Foreground color prediction through inverse compositing

In natural image matting, the goal is to estimate the opacity of the for...
research
10/13/2022

Wider and Higher: Intensive Integration and Global Foreground Perception for Image Matting

This paper reviews recent deep-learning-based matting research and conce...
research
03/28/2018

Context-aware Deep Feature Compression for High-speed Visual Tracking

We propose a new context-aware correlation filter based tracking framewo...
research
04/07/2020

Hierarchical Opacity Propagation for Image Matting

Natural image matting is a fundamental problem in computational photogra...
research
12/15/2020

Improved Image Matting via Real-time User Clicks and Uncertainty Estimation

Image matting is a fundamental and challenging problem in computer visio...

Please sign up or login with your details

Forgot password? Click here to reset