Real-time Human-Robot Collaborative Manipulations of Cylindrical and Cubic Objects via Geometric Primitives and Depth Information

06/28/2021
by   Huixu Dong, et al.
0

Many objects commonly found in household and industrial environments are represented by cylindrical and cubic shapes. Thus, it is available for robots to manipulate them through the real-time detection of elliptic and rectangle shape primitives formed by the circular and rectangle tops of these objects. We devise a robust grasping system that enables a robot to manipulate cylindrical and cubic objects in collaboration scenarios by the proposed perception strategy including the detection of elliptic and rectangle shape primitives and depth information. The proposed method of detecting ellipses and rectangles incorporates a one-stage detection backbone and then, accommodates the proposed adaptive multi-branch multi-scale net with a designed iterative feature pyramid network, local inception net, and multi-receptive-filed feature fusion net to generate object detection recommendations. In terms of manipulating objects with different shapes, we propose the grasp synthetic to align the grasp pose of the gripper with an object's pose based on the proposed detector and registered depth information. The proposed robotic perception algorithm has been integrated on a robot to demonstrate the ability to carry out human-robot collaborative manipulations of cylindrical and cubic objects in real-time. We show that the robotic manipulator, empowered by the proposed detector, performs well in practical manipulation scenarios.(An experiment video is available in YouTube, https://www.youtube.com/watch?v=Amcs8lwvNK8.)

READ FULL TEXT

page 1

page 3

page 4

page 7

page 8

research
06/02/2020

Object-Independent Human-to-Robot Handovers using Real Time Robotic Vision

We present an approach for safe and object-independent human-to-robot ha...
research
01/18/2021

Object Detection and Pose Estimation from RGB and Depth Data for Real-time, Adaptive Robotic Grasping

In recent times, object detection and pose estimation have gained signif...
research
09/12/2019

Using Synthetic Data and Deep Networks to Recognize Primitive Shapes for Object Grasping

A segmentation-based architecture is proposed to decompose objects into ...
research
05/16/2023

Real-time Simultaneous Multi-Object 3D Shape Reconstruction, 6DoF Pose Estimation and Dense Grasp Prediction

Robotic manipulation systems operating in complex environments rely on p...
research
02/10/2020

Learning to Grasp 3D Objects using Deep Residual U-Nets

Affordance detection is one of the challenging tasks in robotics because...
research
11/17/2020

Reactive Human-to-Robot Handovers of Arbitrary Objects

Human-robot object handovers have been an actively studied area of robot...
research
04/02/2021

Robotic Waste Sorter with Agile Manipulation and Quickly Trainable Detector

Owing to human labor shortages, the automation of labor-intensive manual...

Please sign up or login with your details

Forgot password? Click here to reset