Evaluating the Single-Shot MultiBox Detector and YOLO Deep Learning Models for the Detection of Tomatoes in a Greenhouse

09/02/2021
by   Sandro A. Magalhães, et al.
12

The development of robotic solutions for agriculture requires advanced perception capabilities that can work reliably in any crop stage. For example, to automatise the tomato harvesting process in greenhouses, the visual perception system needs to detect the tomato in any life cycle stage (flower to the ripe tomato). The state-of-the-art for visual tomato detection focuses mainly on ripe tomato, which has a distinctive colour from the background. This paper contributes with an annotated visual dataset of green and reddish tomatoes. This kind of dataset is uncommon and not available for research purposes. This will enable further developments in edge artificial intelligence for in situ and in real-time visual tomato detection required for the development of harvesting robots. Considering this dataset, five deep learning models were selected, trained and benchmarked to detect green and reddish tomatoes grown in greenhouses. Considering our robotic platform specifications, only the Single-Shot MultiBox Detector (SSD) and YOLO architectures were considered. The results proved that the system can detect green and reddish tomatoes, even those occluded by leaves. SSD MobileNet v2 had the best performance when compared against SSD Inception v2, SSD ResNet 50, SSD ResNet 101 and YOLOv4 Tiny, reaching an F1-score of 66.15 inference time of 16.44 ms with the NVIDIA Turing Architecture platform, an NVIDIA Tesla T4, with 12 GB. YOLOv4 Tiny also had impressive results, mainly concerning inferring times of about 5 ms.

READ FULL TEXT

page 2

page 10

page 11

page 12

page 14

page 23

page 24

page 25

research
12/29/2019

Visual Perception and Modelling in Unstructured Orchard for Apple Harvesting Robots

Vision perception and modelling are the essential tasks of robotic harve...
research
09/08/2021

Visual Sensation and Perception Computational Models for Deep Learning: State of the art, Challenges and Prospects

Visual sensation and perception refers to the process of sensing, organi...
research
07/12/2019

Tiny-Inception-ResNet-v2: Using Deep Learning for Eliminating Bonded Labors of Brick Kilns in South Asia

This paper proposes to employ a Inception-ResNet inspired deep learning ...
research
10/09/2018

DeepWeeds: A Multiclass Weed Species Image Dataset for Deep Learning

Robotic weed control has seen increased research in the past decade with...
research
05/09/2021

Dataset and Performance Comparison of Deep Learning Architectures for Plum Detection and Robotic Harvesting

Many automated operations in agriculture, such as weeding and plant coun...
research
02/17/2020

SpotTheFake: An Initial Report on a New CNN-Enhanced Platform for Counterfeit Goods Detection

The counterfeit goods trade represents nowadays more than 3.3 world trad...

Please sign up or login with your details

Forgot password? Click here to reset