DeepAI
Log In Sign Up

Deep Mangoes: from fruit detection to cultivar identification in colour images of mango trees

09/24/2019
by   Philippe Borianne, et al.
16

This paper presents results on the detection and identification mango fruits from colour images of trees. We evaluate the behaviour and the performances of the Faster R-CNN network to determine whether it is robust enough to "detect and classify" fruits under particularly heterogeneous conditions in terms of plant cultivars, plantation scheme, and visual information acquisition contexts. The network is trained to distinguish the 'Kent', 'Keitt', and "Boucodiekhal" mango cultivars from 3,000 representative labelled fruit annotations. The validation set composed of about 7,000 annotations was then tested with a confidence threshold of 0.7 and a Non-Maximal-Suppression threshold of 0.25. With a F1-score of 0.90, the Faster R-CNN is well suitable to the simple fruit detection in tiles of 500x500 pixels. We then combine a multi-tiling approach with a Jaccard matrix to merge the different parts of objects detected several times, and thus report the detections made at the tile scale to the native 6,000x4,000 pixel size images. Nonetheless with a F1-score of 0.56, the cultivar identification Faster R-CNN network presents some limitations for simultaneously detecting the mango fruits and identifying their respective cultivars. Despite the proven errors in fruit detection, the cultivar identification rates of the detected mango fruits are in the order of 80 pre-segmentation of trees and a double-stream Faster R-CNN for detecting the mango fruits and identifying their respective cultivar to provide predictions more relevant to users' expectations.

READ FULL TEXT

page 3

page 4

page 5

page 6

08/26/2020

Inno at SemEval-2020 Task 11: Leveraging Pure Transformer for Multi-Class Propaganda Detection

The paper presents the solution of team "Inno" to a SEMEVAL 2020 task 11...
11/23/2018

An Adaptive Approach for Automated Grapevine Phenotyping using VGG-based Convolutional Neural Networks

In (grapevine) breeding programs and research, periodic phenotyping and ...
10/11/2019

Snow avalanche segmentation in SAR images with Fully Convolutional Neural Networks

Knowledge about frequency and location of snow avalanche activity is ess...
12/01/2022

Motion Informed Object Detection of Small Insects in Time-lapse Camera Recordings

Insects as pollinators play a key role in ecosystem management and world...
07/08/2020

Quality Classification of Defective Parts from Injection Moulding

This report examines machine learning algorithms for detecting short for...
04/24/2018

Explaining hyperspectral imaging based plant disease identification: 3D CNN and saliency maps

Our overarching goal is to develop an accurate and explainable model for...