Towards real-time object recognition and pose estimation in point clouds

11/27/2020
by   Marlon Marcon, et al.
0

Object recognition and 6DoF pose estimation are quite challenging tasks in computer vision applications. Despite efficiency in such tasks, standard methods deliver far from real-time processing rates. This paper presents a novel pipeline to estimate a fine 6DoF pose of objects, applied to realistic scenarios in real-time. We split our proposal into three main parts. Firstly, a Color feature classification leverages the use of pre-trained CNN color features trained on the ImageNet for object detection. A Feature-based registration module conducts a coarse pose estimation, and finally, a Fine-adjustment step performs an ICP-based dense registration. Our proposal achieves, in the best case, an accuracy performance of almost 83% on the RGB-D Scenes dataset. Regarding processing time, the object detection task is done at a frame processing rate up to 90 FPS, and the pose estimation at almost 14 FPS in a full execution strategy. We discuss that due to the proposal's modularity, we could let the full execution occurs only when necessary and perform a scheduled execution that unlocks real-time processing, even for multitask situations.

READ FULL TEXT

page 4

page 9

page 10

research
04/11/2020

A Novel Pose Proposal Network and Refinement Pipeline for Better Object Pose Estimation

In this paper, we present a novel deep learning pipeline for 6D object p...
research
07/15/2021

Spectral Processing and Optimization of Static and Dynamic 3D Geometries

Geometry processing of 3D objects is of primary interest in many areas o...
research
03/19/2019

Pose-Invariant Object Recognition for Event-Based Vision with Slow-ELM

Neuromorphic image sensors produce activity-driven spiking output at eve...
research
11/11/2021

6D Pose Estimation with Combined Deep Learning and 3D Vision Techniques for a Fast and Accurate Object Grasping

Real-time robotic grasping, supporting a subsequent precise object-in-ha...
research
11/06/2019

Boosting Object Recognition in Point Clouds by Saliency Detection

Object recognition in 3D point clouds is a challenging task, mainly when...
research
01/30/2009

A Keygraph Classification Framework for Real-Time Object Detection

In this paper, we propose a new approach for keypoint-based object detec...
research
04/10/2015

A Coarse-to-Fine Model for 3D Pose Estimation and Sub-category Recognition

Despite the fact that object detection, 3D pose estimation, and sub-cate...

Please sign up or login with your details

Forgot password? Click here to reset