Multispectral Image Segmentation in Agriculture: A Comprehensive Study on Fusion Approaches

07/31/2023
by   Nuno Cunha, et al.
0

Multispectral imagery is frequently incorporated into agricultural tasks, providing valuable support for applications such as image segmentation, crop monitoring, field robotics, and yield estimation. From an image segmentation perspective, multispectral cameras can provide rich spectral information, helping with noise reduction and feature extraction. As such, this paper concentrates on the use of fusion approaches to enhance the segmentation process in agricultural applications. More specifically, in this work, we compare different fusion approaches by combining RGB and NDVI as inputs for crop row detection, which can be useful in autonomous robots operating in the field. The inputs are used individually as well as combined at different times of the process (early and late fusion) to perform classical and DL-based semantic segmentation. In this study, two agriculture-related datasets are subjected to analysis using both deep learning (DL)-based and classical segmentation methodologies. The experiments reveal that classical segmentation methods, utilizing techniques such as edge detection and thresholding, can effectively compete with DL-based algorithms, particularly in tasks requiring precise foreground-background separation. This suggests that traditional methods retain their efficacy in certain specialized applications within the agricultural domain. Moreover, among the fusion strategies examined, late fusion emerges as the most robust approach, demonstrating superiority in adaptability and effectiveness across varying segmentation scenarios. The dataset and code is available at https://github.com/Cybonic/MISAgriculture.git.

READ FULL TEXT

page 4

page 12

research
04/18/2019

VoteNet: A Deep Learning Label Fusion Method for Multi-Atlas Segmentation

Deep learning (DL) approaches are state-of-the-art for many medical imag...
research
12/13/2021

Hypernet-Ensemble Learning of Segmentation Probability for Medical Image Segmentation with Ambiguous Labels

Despite the superior performance of Deep Learning (DL) on numerous segme...
research
09/13/2022

SFS-A68: a dataset for the segmentation of space functions in apartment buildings

Analyzing building models for usable area, building safety, or energy an...
research
07/30/2021

Iterative, Deep, and Unsupervised Synthetic Aperture Sonar Image Segmentation

Deep learning has not been routinely employed for semantic segmentation ...
research
08/12/2023

Polyp-SAM++: Can A Text Guided SAM Perform Better for Polyp Segmentation?

Meta recently released SAM (Segment Anything Model) which is a general-p...
research
01/27/2021

Assessing the applicability of Deep Learning-based visible-infrared fusion methods for fire imagery

Early wildfire detection is of paramount importance to avoid as much dam...
research
03/02/2021

HED-UNet: Combined Segmentation and Edge Detection for Monitoring the Antarctic Coastline

Deep learning-based coastline detection algorithms have begun to outshin...

Please sign up or login with your details

Forgot password? Click here to reset