Geometry-Aware Fruit Grasping Estimation for Robotic Harvesting in Orchards

12/08/2021
by   Hanwen Kang, et al.
4

Field robotic harvesting is a promising technique in recent development of agricultural industry. It is vital for robots to recognise and localise fruits before the harvesting in natural orchards. However, the workspace of harvesting robots in orchards is complex: many fruits are occluded by branches and leaves. It is important to estimate a proper grasping pose for each fruit before performing the manipulation. In this study, a geometry-aware network, A3N, is proposed to perform end-to-end instance segmentation and grasping estimation using both color and geometry sensory data from a RGB-D camera. Besides, workspace geometry modelling is applied to assist the robotic manipulation. Moreover, we implement a global-to-local scanning strategy, which enables robots to accurately recognise and retrieve fruits in field environments with two consumer-level RGB-D cameras. We also evaluate the accuracy and robustness of proposed network comprehensively in experiments. The experimental results show that A3N achieves 0.873 on instance segmentation accuracy, with an average computation time of 35 ms. The average accuracy of grasping estimation is 0.61 cm and 4.8^∘ in centre and orientation, respectively. Overall, the robotic system that utilizes the global-to-local scanning and A3N, achieves success rate of harvesting ranging from 70% - 85% in field harvesting experiments.

READ FULL TEXT

page 1

page 4

page 5

page 6

page 7

research
03/30/2020

Real-time Fruit Recognition and Grasp Estimation for Autonomous Apple harvesting

In this research, a fully neural network based visual perception framewo...
research
05/01/2022

Accurate Fruit Localisation for Robotic Harvesting using High Resolution LiDAR-Camera Fusion

Accurate depth-sensing plays a crucial role in securing a high success r...
research
11/18/2021

Predictive Scheduling of Collaborative Mobile Robots for Improved Crop-transport Logistics of Manually Harvested Crops

Mechanizing the manual harvesting of fresh market fruits constitutes one...
research
07/25/2022

Peduncle Gripping and Cutting Force for Strawberry Harvesting Robotic End-effector Design

Robotic harvesting of strawberries has gained much interest in the recen...
research
07/27/2021

A strawberry harvest-aiding system with crop-transport co-robots: Design, development, and field evaluation

Mechanizing the manual harvesting of fresh market fruits constitutes one...
research
09/21/2018

3D Move to See: Multi-perspective visual servoing for improving object views with semantic segmentation

In this paper, we present a new approach to visual servoing for robotics...
research
04/26/2023

Machine Vision-Based Crop-Load Estimation Using YOLOv8

Labor shortages in fruit crop production have prompted the development o...

Please sign up or login with your details

Forgot password? Click here to reset