Reliable Evaluation of Neural Network for Multiclass Classification of Real-world Data

11/30/2016
by   Siddharth Dinesh, et al.
0

This paper presents a systematic evaluation of Neural Network (NN) for classification of real-world data. In the field of machine learning, it is often seen that a single parameter that is 'predictive accuracy' is being used for evaluating the performance of a classifier model. However, this parameter might not be considered reliable given a dataset with very high level of skewness. To demonstrate such behavior, seven different types of datasets have been used to evaluate a Multilayer Perceptron (MLP) using twelve(12) different parameters which include micro- and macro-level estimation. In the present study, the most common problem of prediction called 'multiclass' classification has been considered. The results that are obtained for different parameters for each of the dataset could demonstrate interesting findings to support the usability of these set of performance evaluation parameters.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/08/2021

Evaluating Predictive Uncertainty and Robustness to Distributional Shift Using Real World Data

Most machine learning models operate under the assumption that the train...
research
05/11/2023

Liver Infection Prediction Analysis using Machine Learning to Evaluate Analytical Performance in Neural Networks by Optimization Techniques

Liver infection is a common disease, which poses a great threat to human...
research
05/01/2023

A novel algorithm can generate data to train machine learning models in conditions of extreme scarcity of real world data

Training machine learning models requires large datasets. However, colle...
research
06/29/2020

GLYFE: Review and Benchmark of Personalized Glucose Predictive Models in Type-1 Diabetes

Due to the sensitive nature of diabetes-related data, preventing them fr...
research
04/14/2023

Airborne-Sound Analysis for the Detection of Bearing Faults in Railway Vehicles with Real-World Data

In this paper, we address the challenging problem of detecting bearing f...
research
05/27/2011

Issues in Stacked Generalization

Stacked generalization is a general method of using a high-level model t...

Please sign up or login with your details

Forgot password? Click here to reset