GlassLoc: Plenoptic Grasp Pose Detection in Transparent Clutter

09/10/2019
by   Zheming Zhou, et al.
5

Transparent objects are prevalent across many environments of interest for dexterous robotic manipulation. Such transparent material leads to considerable uncertainty for robot perception and manipulation, and remains an open challenge for robotics. This problem is exacerbated when multiple transparent objects cluster into piles of clutter. In household environments, for example, it is common to encounter piles of glassware in kitchens, dining rooms, and reception areas, which are essentially invisible to modern robots. We present the GlassLoc algorithm for grasp pose detection of transparent objects in transparent clutter using plenoptic sensing. GlassLoc classifies graspable locations in space informed by a Depth Likelihood Volume (DLV) descriptor. We extend the DLV to infer the occupancy of transparent objects over a given space from multiple plenoptic viewpoints. We demonstrate and evaluate the GlassLoc algorithm on a Michigan Progress Fetch mounted with a first-generation Lytro. The effectiveness of our algorithm is evaluated through experiments for grasp detection and execution with a variety of transparent glassware in minor clutter.

READ FULL TEXT

page 1

page 2

page 4

page 5

page 6

page 7

research
10/27/2021

Dex-NeRF: Using a Neural Radiance Field to Grasp Transparent Objects

The ability to grasp and manipulate transparent objects is a major chall...
research
07/11/2022

A4T: Hierarchical Affordance Detection for Transparent Objects Depth Reconstruction and Manipulation

Transparent objects are widely used in our daily lives and therefore rob...
research
06/30/2021

SimNet: Enabling Robust Unknown Object Manipulation from Pure Synthetic Data via Stereo

Robot manipulation of unknown objects in unstructured environments is a ...
research
04/03/2022

Efficient and Accurate Candidate Generation for Grasp Pose Detection in SE(3)

Grasp detection of novel objects in unstructured environments is a key c...
research
03/31/2023

Robotic Perception of Transparent Objects: A Review

Transparent object perception is a rapidly developing research problem i...
research
09/18/2023

TransTouch: Learning Transparent Objects Depth Sensing Through Sparse Touches

Transparent objects are common in daily life. However, depth sensing for...
research
06/03/2016

On Recognizing Transparent Objects in Domestic Environments Using Fusion of Multiple Sensor Modalities

Current object recognition methods fail on object sets that include both...

Please sign up or login with your details

Forgot password? Click here to reset