DeepAI AI Chat
Log In Sign Up

Geometry-Aware Fruit Grasping Estimation for Robotic Harvesting in Orchards

by   Hanwen Kang, et al.

Field robotic harvesting is a promising technique in recent development of agricultural industry. It is vital for robots to recognise and localise fruits before the harvesting in natural orchards. However, the workspace of harvesting robots in orchards is complex: many fruits are occluded by branches and leaves. It is important to estimate a proper grasping pose for each fruit before performing the manipulation. In this study, a geometry-aware network, A3N, is proposed to perform end-to-end instance segmentation and grasping estimation using both color and geometry sensory data from a RGB-D camera. Besides, workspace geometry modelling is applied to assist the robotic manipulation. Moreover, we implement a global-to-local scanning strategy, which enables robots to accurately recognise and retrieve fruits in field environments with two consumer-level RGB-D cameras. We also evaluate the accuracy and robustness of proposed network comprehensively in experiments. The experimental results show that A3N achieves 0.873 on instance segmentation accuracy, with an average computation time of 35 ms. The average accuracy of grasping estimation is 0.61 cm and 4.8^∘ in centre and orientation, respectively. Overall, the robotic system that utilizes the global-to-local scanning and A3N, achieves success rate of harvesting ranging from 70% - 85% in field harvesting experiments.


page 1

page 4

page 5

page 6

page 7


Real-time Fruit Recognition and Grasp Estimation for Autonomous Apple harvesting

In this research, a fully neural network based visual perception framewo...

Accurate Fruit Localisation for Robotic Harvesting using High Resolution LiDAR-Camera Fusion

Accurate depth-sensing plays a crucial role in securing a high success r...

Predictive Scheduling of Collaborative Mobile Robots for Improved Crop-transport Logistics of Manually Harvested Crops

Mechanizing the manual harvesting of fresh market fruits constitutes one...

3D Move to See: Multi-perspective visual servoing for improving object views with semantic segmentation

In this paper, we present a new approach to visual servoing for robotics...

Peduncle Gripping and Cutting Force for Strawberry Harvesting Robotic End-effector Design

Robotic harvesting of strawberries has gained much interest in the recen...

A strawberry harvest-aiding system with crop-transport co-robots: Design, development, and field evaluation

Mechanizing the manual harvesting of fresh market fruits constitutes one...

Machine Vision-Based Crop-Load Estimation Using YOLOv8

Labor shortages in fruit crop production have prompted the development o...