TransNet: Category-Level Transparent Object Pose Estimation

by   Huijie Zhang, et al.

Transparent objects present multiple distinct challenges to visual perception systems. First, their lack of distinguishing visual features makes transparent objects harder to detect and localize than opaque objects. Even humans find certain transparent surfaces with little specular reflection or refraction, e.g. glass doors, difficult to perceive. A second challenge is that common depth sensors typically used for opaque object perception cannot obtain accurate depth measurements on transparent objects due to their unique reflective properties. Stemming from these challenges, we observe that transparent object instances within the same category (e.g. cups) look more similar to each other than to ordinary opaque objects of that same category. Given this observation, the present paper sets out to explore the possibility of category-level transparent object pose estimation rather than instance-level pose estimation. We propose TransNet, a two-stage pipeline that learns to estimate category-level transparent object pose using localized depth completion and surface normal estimation. TransNet is evaluated in terms of pose estimation accuracy on a recent, large-scale transparent object dataset and compared to a state-of-the-art category-level pose estimation approach. Results from this comparison demonstrate that TransNet achieves improved pose estimation accuracy on transparent objects and key findings from the included ablation studies suggest future directions for performance improvements.


page 3

page 14


TransNet: Transparent Object Manipulation Through Category-Level Pose Estimation

Transparent objects present multiple distinct challenges to visual perce...

StereoPose: Category-Level 6D Transparent Object Pose Estimation from Stereo Images via Back-View NOCS

Most existing methods for category-level pose estimation rely on object ...

Polarimetric Pose Prediction

Light has many properties that can be passively measured by vision senso...

Locating Transparent Objects to Millimetre Accuracy

Transparent surfaces, such as glass, transmit most of the visible light ...

You Only Look at One: Category-Level Object Representations for Pose Estimation From a Single Example

In order to meaningfully interact with the world, robot manipulators mus...

Robotic Perception of Transparent Objects: A Review

Transparent object perception is a rapidly developing research problem i...

ProgressLabeller: Visual Data Stream Annotation for Training Object-Centric 3D Perception

Visual perception tasks often require vast amounts of labelled data, inc...

Please sign up or login with your details

Forgot password? Click here to reset