DeepAI
Log In Sign Up

Improved Image Matting via Real-time User Clicks and Uncertainty Estimation

12/15/2020
by   Tianyi Wei, et al.
11

Image matting is a fundamental and challenging problem in computer vision and graphics. Most existing matting methods leverage a user-supplied trimap as an auxiliary input to produce good alpha matte. However, obtaining high-quality trimap itself is arduous, thus restricting the application of these methods. Recently, some trimap-free methods have emerged, however, the matting quality is still far behind the trimap-based methods. The main reason is that, without the trimap guidance in some cases, the target network is ambiguous about which is the foreground target. In fact, choosing the foreground is a subjective procedure and depends on the user's intention. To this end, this paper proposes an improved deep image matting framework which is trimap-free and only needs several user click interactions to eliminate the ambiguity. Moreover, we introduce a new uncertainty estimation module that can predict which parts need polishing and a following local refinement module. Based on the computation budget, users can choose how many local parts to improve with the uncertainty guidance. Quantitative and qualitative results show that our method performs better than existing trimap-free methods and comparably to state-of-the-art trimap-based methods with minimal user effort.

READ FULL TEXT

page 4

page 6

page 7

page 8

10/21/2021

Deep Image Matting with Flexible Guidance Input

Image matting is an important computer vision problem. Many existing mat...
04/20/2022

PP-Matting: High-Accuracy Natural Image Matting

Natural image matting is a fundamental and challenging computer vision t...
08/20/2021

Structure-Preserving Deraining with Residue Channel Prior Guidance

Single image deraining is important for many high-level computer vision ...
04/15/2021

A Simple Baseline for StyleGAN Inversion

This paper studies the problem of StyleGAN inversion, which plays an ess...
09/20/2019

Context-Aware Image Matting for Simultaneous Foreground and Alpha Estimation

Natural image matting is an important problem in computer vision and gra...
05/06/2021

Cascade Image Matting with Deformable Graph Refinement

Image matting refers to the estimation of the opacity of foreground obje...
06/04/2020

2D Image Features Detector And Descriptor Selection Expert System

Detection and description of keypoints from an image is a well-studied p...