Object Detection and Pose Estimation from RGB and Depth Data for Real-time, Adaptive Robotic Grasping

01/18/2021
by   S. K. Paul, et al.
12

In recent times, object detection and pose estimation have gained significant attention in the context of robotic vision applications. Both the identification of objects of interest as well as the estimation of their pose remain important capabilities in order for robots to provide effective assistance for numerous robotic applications ranging from household tasks to industrial manipulation. This problem is particularly challenging because of the heterogeneity of objects having different and potentially complex shapes, and the difficulties arising due to background clutter and partial occlusions between objects. As the main contribution of this work, we propose a system that performs real-time object detection and pose estimation, for the purpose of dynamic robot grasping. The robot has been pre-trained to perform a small set of canonical grasps from a few fixed poses for each object. When presented with an unknown object in an arbitrary pose, the proposed approach allows the robot to detect the object identity and its actual pose, and then adapt a canonical grasp in order to be used with the new pose. For training, the system defines a canonical grasp by capturing the relative pose of an object with respect to the gripper attached to the robot's wrist. During testing, once a new pose is detected, a canonical grasp for the object is identified and then dynamically adapted by adjusting the robot arm's joint angles, so that the gripper can grasp the object in its new pose. We conducted experiments using a humanoid PR2 robot and showed that the proposed framework can detect well-textured objects, and provide accurate pose estimation in the presence of tolerable amounts of out-of-plane rotation. The performance is also illustrated by the robot successfully grasping objects from a wide range of arbitrary poses.

READ FULL TEXT

page 1

page 5

page 7

page 8

page 9

research
09/08/2020

A Deep Learning-Based Autonomous RobotManipulator for Sorting Application

Robot manipulation and grasping mechanisms have received considerable at...
research
01/03/2020

Real-time Grasp Pose Estimation for Novel Objects in Densely Cluttered Environment

Grasping of novel objects in pick and place applications is a fundamenta...
research
05/16/2019

Vision-based Robotic Grasping from Object Localization, Pose Estimation, Grasp Detection to Motion Planning: A Review

This paper presents a comprehensive survey on vision-based robotic grasp...
research
06/28/2021

Real-time Human-Robot Collaborative Manipulations of Cylindrical and Cubic Objects via Geometric Primitives and Depth Information

Many objects commonly found in household and industrial environments are...
research
08/24/2023

Robot Pose Nowcasting: Forecast the Future to Improve the Present

In recent years, the effective and safe collaboration between humans and...
research
11/18/2019

MaskedFusion: Mask-based 6D Object Pose Detection

MaskedFusion is a framework to estimate 6D pose of objects using RGB-D d...
research
04/16/2019

Suction Grasp Region Prediction using Self-supervised Learning for Object Picking in Dense Clutter

This paper focuses on robotic picking tasks in cluttered scenario. Becau...

Please sign up or login with your details

Forgot password? Click here to reset