Convolutional neural networks for classification and regression analysis of one-dimensional spectral data

05/15/2020
by   Ine L. Jernelv, et al.
0

Convolutional neural networks (CNNs) are widely used for image recognition and text analysis, and have been suggested for application on one-dimensional data as a way to reduce the need for pre-processing steps. Pre-processing is an integral part of multivariate analysis, but determination of the optimal pre-processing methods can be time-consuming due to the large number of available methods. In this work, the performance of a CNN was investigated for classification and regression analysis of spectral data. The CNN was compared with various other chemometric methods, including support vector machines (SVMs) for classification and partial least squares regression (PLSR) for regression analysis. The comparisons were made both on raw data, and on data that had gone through pre-processing and/or feature selection methods. The models were used on spectral data acquired with methods based on near-infrared, mid-infrared, and Raman spectroscopy. For the classification datasets the models were evaluated based on the percentage of correctly classified observations, while for regression analysis the models were assessed based on the coefficient of determination (R^2). Our results show that CNNs can outperform standard chemometric methods, especially for classification tasks where no pre-processing is used. However, both CNN and the standard chemometric methods see improved performance when proper pre-processing and feature selection methods are used. These results demonstrate some of the capabilities and limitations of CNNs used on one-dimensional data.

READ FULL TEXT
research
11/04/2019

Human eye inspired log-polar pre-processing for neural networks

In this paper we draw inspiration from the human visual system, and pres...
research
01/24/2023

1D Convolutional neural networks and machine learning algorithms for spectral data classification with a case study for Covid-19

Machine and deep learning algorithms have increasingly been applied to s...
research
03/22/2018

A Comprehensive Analysis of Deep Regression

Deep learning revolutionized data science, and recently, its popularity ...
research
01/04/2023

Machine Learning technique for isotopic determination of radioisotopes using HPGe -ray spectra

γ-ray spectroscopy is a quantitative, non-destructive technique that may...
research
02/05/2018

Analysis of Complex System Development Based on Fuzzy Cognitive Mapping

This article represents one of the contemporary trends in the applicatio...
research
03/02/2018

PRESISTANT: Learning based assistant for data pre-processing

Data pre-processing is one of the most time consuming and relevant steps...
research
11/08/2021

A Novel Data Pre-processing Technique: Making Data Mining Robust to Different Units and Scales of Measurement

Many existing data mining algorithms use feature values directly in thei...

Please sign up or login with your details

Forgot password? Click here to reset