Mushrooms Detection, Localization and 3D Pose Estimation using RGB-D Sensor for Robotic-picking Applications

01/08/2022
by   Nathanael L. Baisa, et al.
18

In this paper, we propose mushrooms detection, localization and 3D pose estimation algorithm using RGB-D data acquired from a low-cost consumer RGB-D sensor. We use the RGB and depth information for different purposes. From RGB color, we first extract initial contour locations of the mushrooms and then provide both the initial contour locations and the original image to active contour for mushrooms segmentation. These segmented mushrooms are then used as input to a circular Hough transform for each mushroom detection including its center and radius. Once each mushroom's center position in the RGB image is known, we then use the depth information to locate it in 3D space i.e. in world coordinate system. In case of missing depth information at the detected center of each mushroom, we estimate from the nearest available depth information within the radius of each mushroom. We also estimate the 3D pose of each mushroom using a pre-prepared upright mushroom model. We use a global registration followed by local refine registration approach for this 3D pose estimation. From the estimated 3D pose, we use only the rotation part expressed in quaternion as an orientation of each mushroom. These estimated (X,Y,Z) positions, diameters and orientations of the mushrooms are used for robotic-picking applications. We carry out extensive experiments on both 3D printed and real mushrooms which show that our method has an interesting performance.

READ FULL TEXT

page 5

page 7

page 8

page 9

page 10

page 11

page 12

page 13

research
05/03/2017

Learning to Estimate 3D Hand Pose from Single RGB Images

Low-cost consumer depth cameras and deep learning have enabled reasonabl...
research
04/16/2019

Combining RGB and Points to Predict Grasping Region for Robotic Bin-Picking

This paper focuses on a robotic picking tasks in cluttered scenario. Bec...
research
01/19/2019

Endoscopic vs. volumetric OCT imaging of mastoid bone structure for pose estimation in minimally invasive cochlear implant surgery

Purpose: The facial recess is a delicate structure that must be protecte...
research
02/13/2023

Contour Context: Abstract Structural Distribution for 3D LiDAR Loop Detection and Metric Pose Estimation

This paper proposes Contour Context, a simple, effective, and efficient ...
research
02/03/2020

YOLOff: You Only Learn Offsets for robust 6DoF object pose estimation

Estimating the 3D translation and orientation of an object is a challeng...
research
09/24/2021

Low Cost Bin Picking Solution for E-Commerce Warehouse Fulfillment Centers

In recent years, the throughput requirements of e-commerce fulfillment w...

Please sign up or login with your details

Forgot password? Click here to reset