6D Pose Estimation with Combined Deep Learning and 3D Vision Techniques for a Fast and Accurate Object Grasping

11/11/2021
by   Tuan-Tang Le, et al.
19

Real-time robotic grasping, supporting a subsequent precise object-in-hand operation task, is a priority target towards highly advanced autonomous systems. However, such an algorithm which can perform sufficiently-accurate grasping with time efficiency is yet to be found. This paper proposes a novel method with a 2-stage approach that combines a fast 2D object recognition using a deep neural network and a subsequent accurate and fast 6D pose estimation based on Point Pair Feature framework to form a real-time 3D object recognition and grasping solution capable of multi-object class scenes. The proposed solution has a potential to perform robustly on real-time applications, requiring both efficiency and accuracy. In order to validate our method, we conducted extensive and thorough experiments involving laborious preparation of our own dataset. The experiment results show that the proposed method scores 97.37 Experiment results have shown an overall 62 metric) and 52.48 Moreover, the pose estimation execution also showed an average improvement of 47.6 system in real-time operations, a pick-and-place robotic experiment is conducted and has shown a convincing success rate with 90 experiment video is available at https://sites.google.com/view/dl-ppf6dpose/.

READ FULL TEXT

page 15

page 17

page 20

page 21

page 22

page 23

page 24

page 28

research
12/03/2020

Object-Driven Active Mapping for More Accurate Object Pose Estimation and Robotic Grasping

This paper presents the first active object mapping framework for comple...
research
04/10/2023

ShapeShift: Superquadric-based Object Pose Estimation for Robotic Grasping

Object pose estimation is a critical task in robotics for precise object...
research
11/27/2020

Towards real-time object recognition and pose estimation in point clouds

Object recognition and 6DoF pose estimation are quite challenging tasks ...
research
03/01/2022

Adversarial samples for deep monocular 6D object pose estimation

Estimating object 6D pose from an RGB image is important for many real-w...
research
01/25/2021

Lightweight Convolutional Neural Network with Gaussian-based Grasping Representation for Robotic Grasping Detection

The method of deep learning has achieved excellent results in improving ...
research
02/15/2021

Field Evaluations of A Deep Learning-based Intelligent Spraying Robot with Flow Control for Pear Orchards

This paper proposes a variable flow control system in real time with dee...
research
03/19/2019

Pose-Invariant Object Recognition for Event-Based Vision with Slow-ELM

Neuromorphic image sensors produce activity-driven spiking output at eve...

Please sign up or login with your details

Forgot password? Click here to reset