Cascade Image Matting with Deformable Graph Refinement

05/06/2021
by   Zijian Yu, et al.
2

Image matting refers to the estimation of the opacity of foreground objects. It requires correct contours and fine details of foreground objects for the matting results. To better accomplish human image matting tasks, we propose the Cascade Image Matting Network with Deformable Graph Refinement, which can automatically predict precise alpha mattes from single human images without any additional inputs. We adopt a network cascade architecture to perform matting from low-to-high resolution, which corresponds to coarse-to-fine optimization. We also introduce the Deformable Graph Refinement (DGR) module based on graph neural networks (GNNs) to overcome the limitations of convolutional neural networks (CNNs). The DGR module can effectively capture long-range relations and obtain more global and local information to help produce finer alpha mattes. We also reduce the computation complexity of the DGR module by dynamically predicting the neighbors and apply DGR module to higher–resolution features. Experimental results demonstrate the ability of our CasDGR to achieve state-of-the-art performance on synthetic datasets and produce good results on real human images.

READ FULL TEXT

page 4

page 6

page 8

page 9

research
12/29/2021

Deformable Graph Convolutional Networks

Graph neural networks (GNNs) have significantly improved the representat...
research
02/04/2019

Graph Warp Module: an Auxiliary Module for Boosting the Power of Graph Neural Networks

Recently, Graph Neural Networks (GNNs) are trending in the machine learn...
research
07/30/2018

Semantic Labeling in Very High Resolution Images via a Self-Cascaded Convolutional Neural Network

Semantic labeling for very high resolution (VHR) images in urban areas, ...
research
01/17/2021

Temporal Spatial-Adaptive Interpolation with Deformable Refinement for Electron Microscopic Images

Recently, flow-based methods have achieved promising success in video fr...
research
06/17/2009

Deformable Model with a Complexity Independent from Image Resolution

We present a parametric deformable model which recovers image components...
research
12/04/2018

Zoom-In-to-Check: Boosting Video Interpolation via Instance-level Discrimination

We propose a light-weight video frame interpolation algorithm. Our key i...
research
10/01/2020

Multiscale Detection of Cancerous Tissue in High Resolution Slide Scans

We present an algorithm for multi-scale tumor (chimeric cell) detection ...

Please sign up or login with your details

Forgot password? Click here to reset