Segmenting Transparent Objects in the Wild

03/31/2020
by   Enze Xie, et al.
0

Transparent objects such as windows and bottles made by glass widely exist in the real world. Segmenting transparent objects is challenging because these objects have diverse appearance inherited from the image background, making them had similar appearance with their surroundings. Besides the technical difficulty of this task, only a few previous datasets were specially designed and collected to explore this task and most of the existing datasets have major drawbacks. They either possess limited sample size such as merely a thousand of images without manual annotations, or they generate all images by using computer graphics method (i.e. not real image). To address this important problem, this work proposes a large-scale dataset for transparent object segmentation, named Trans10K, consisting of 10,428 images of real scenarios with carefully manual annotations, which are 10 times larger than the existing datasets. The transparent objects in Trans10K are extremely challenging due to high diversity in scale, viewpoint and occlusion as shown in Fig. 1. To evaluate the effectiveness of Trans10K, we propose a novel boundary-aware segmentation method, termed TransLab, which exploits boundary as the clue to improve segmentation of transparent objects. Extensive experiments and ablation studies demonstrate the effectiveness of Trans10K and validate the practicality of learning object boundary in TransLab. For example, TransLab significantly outperforms 20 recent object segmentation methods based on deep learning, showing that this task is largely unsolved. We believe that both Trans10K and TransLab have important contributions to both the academia and industry, facilitating future researches and applications.

READ FULL TEXT

page 2

page 5

page 7

page 13

page 17

page 18

page 19

page 20

research
03/03/2022

Self-supervised Transparent Liquid Segmentation for Robotic Pouring

Liquid state estimation is important for robotics tasks such as pouring;...
research
03/24/2021

FakeMix Augmentation Improves Transparent Object Detection

Detecting transparent objects in natural scenes is challenging due to th...
research
09/25/2017

Realizing Half-Diminished Reality from Video Stream of Manipulating Objects

When we watch a video, in which human hands manipulate objects, these ha...
research
07/07/2021

Trans4Trans: Efficient Transformer for Transparent Object Segmentation to Help Visually Impaired People Navigate in the Real World

Common fully glazed facades and transparent objects present architectura...
research
07/25/2019

Learning Transparent Object Matting

This paper addresses the problem of image matting for transparent object...
research
03/13/2018

TOM-Net: Learning Transparent Object Matting from a Single Image

This paper addresses the problem of transparent object matting. Existing...
research
07/01/2023

Internal-External Boundary Attention Fusion for Glass Surface Segmentation

Glass surfaces of transparent objects and mirrors are not able to be uni...

Please sign up or login with your details

Forgot password? Click here to reset