Robotic Perception of Transparent Objects: A Review

03/31/2023
by   Jiaqi Jiang, et al.
0

Transparent object perception is a rapidly developing research problem in artificial intelligence. The ability to perceive transparent objects enables robots to achieve higher levels of autonomy, unlocking new applications in various industries such as healthcare, services and manufacturing. Despite numerous datasets and perception methods being proposed in recent years, there is still a lack of in-depth understanding of these methods and the challenges in this field. To address this gap, this article provides a comprehensive survey of the platforms and recent advances for robotic perception of transparent objects. We highlight the main challenges and propose future directions of various transparent object perception tasks, i.e., segmentation, reconstruction, and pose estimation. We also discuss the limitations of existing datasets in diversity and complexity, and the benefits of employing multi-modal sensors, such as RGB-D cameras, thermal cameras, and polarised imaging, for transparent object perception. Furthermore, we identify perception challenges in complex and dynamic environments, as well as for objects with changeable geometries. Finally, we provide an interactive online platform to navigate each reference: <https://sites.google.com/view/transperception>.

READ FULL TEXT

page 1

page 2

page 3

page 5

page 7

page 10

page 13

page 17

research
02/22/2023

MVTrans: Multi-View Perception of Transparent Objects

Transparent object perception is a crucial skill for applications such a...
research
04/25/2022

Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Items

Interactive 3D simulations have enabled breakthroughs in robotics and co...
research
08/22/2022

TransNet: Category-Level Transparent Object Pose Estimation

Transparent objects present multiple distinct challenges to visual perce...
research
07/11/2023

TRansPose: Large-Scale Multispectral Dataset for Transparent Object

Transparent objects are encountered frequently in our daily lives, yet r...
research
09/30/2021

Seeing Glass: Joint Point Cloud and Depth Completion for Transparent Objects

The basis of many object manipulation algorithms is RGB-D input. Yet, co...
research
09/10/2019

GlassLoc: Plenoptic Grasp Pose Detection in Transparent Clutter

Transparent objects are prevalent across many environments of interest f...
research
05/11/2022

Review on Panoramic Imaging and Its Applications in Scene Understanding

With the rapid development of high-speed communication and artificial in...

Please sign up or login with your details

Forgot password? Click here to reset