TransMatting: Enhancing Transparent Objects Matting with Transformers

08/05/2022
by   Huanqia Cai, et al.
0

Image matting refers to predicting the alpha values of unknown foreground areas from natural images. Prior methods have focused on propagating alpha values from known to unknown regions. However, not all natural images have a specifically known foreground. Images of transparent objects, like glass, smoke, web, etc., have less or no known foreground. In this paper, we propose a Transformer-based network, TransMatting, to model transparent objects with a big receptive field. Specifically, we redesign the trimap as three learnable tri-tokens for introducing advanced semantic features into the self-attention mechanism. A small convolutional network is proposed to utilize the global feature and non-background mask to guide the multi-scale feature propagation from encoder to decoder for maintaining the contexture of transparent objects. In addition, we create a high-resolution matting dataset of transparent objects with small known foreground areas. Experiments on several matting benchmarks demonstrate the superiority of our proposed method over the current state-of-the-art methods.

READ FULL TEXT

page 12

page 13

research
03/11/2023

TransMatting: Tri-token Equipped Transformer Model for Image Matting

Image matting aims to predict alpha values of elaborate uncertainty area...
research
07/15/2021

Deep Automatic Natural Image Matting

Automatic image matting (AIM) refers to estimating the soft foreground f...
research
04/16/2021

Semantic Image Matting

Natural image matting separates the foreground from background in fracti...
research
03/10/2017

Deep Image Matting

Image matting is a fundamental computer vision problem and has many appl...
research
07/25/2019

Learning Transparent Object Matting

This paper addresses the problem of image matting for transparent object...
research
03/13/2018

TOM-Net: Learning Transparent Object Matting from a Single Image

This paper addresses the problem of transparent object matting. Existing...

Please sign up or login with your details

Forgot password? Click here to reset