Towards Active Robotic Vision in Agriculture: A Deep Learning Approach to Visual Servoing in Occluded and Unstructured Protected Cropping Environments

08/05/2019
by   Paul Zapotezny-Anderson, et al.
0

3D Move To See (3DMTS) is a mutli-perspective visual servoing method for unstructured and occluded environments, like that encountered in robotic crop harvesting. This paper presents a deep learning method, Deep-3DMTS for creating a single-perspective approach for 3DMTS through the use of a Convolutional Neural Network (CNN). The novel method is developed and validated via simulation against the standard 3DMTS approach. The Deep-3DMTS approach is shown to have performance equivalent to the standard 3DMTS baseline in guiding the end effector of a robotic arm to improve the view of occluded fruit (sweet peppers): end effector final position within 11.4 mm of the baseline; and an increase in fruit size in the image by a factor of 17.8 compared to the baseline of 16.8 (avg.).

READ FULL TEXT

page 2

page 5

research
09/21/2018

3D Move to See: Multi-perspective visual servoing for improving object views with semantic segmentation

In this paper, we present a new approach to visual servoing for robotics...
research
12/31/2020

Robotic Grasping of Fully-Occluded Objects using RF Perception

We present the design, implementation, and evaluation of RF-Grasp, a rob...
research
07/28/2022

HOB-CNN: Hallucination of Occluded Branches with a Convolutional Neural Network for 2D Fruit Trees

Orchard automation has attracted the attention of researchers recently d...
research
12/29/2019

Visual Perception and Modelling in Unstructured Orchard for Apple Harvesting Robots

Vision perception and modelling are the essential tasks of robotic harve...
research
01/27/2021

Controlling by Showing: i-Mimic: A Video-based Method to Control Robotic Arms

A novel concept of vision-based intelligent control of robotic arms is d...
research
04/12/2012

Seeing Unseeability to See the Unseeable

We present a framework that allows an observer to determine occluded por...
research
10/29/2018

A Sweet Pepper Harvesting Robot for Protected Cropping Environments

Using robots to harvest sweet peppers in protected cropping environments...

Please sign up or login with your details

Forgot password? Click here to reset