Spectral Metric for Dataset Complexity Assessment

In this paper, we propose a new measure to gauge the complexity of image classification problems. Given an annotated image dataset, our method computes a complexity measure called the cumulative spectral gradient (CSG) which strongly correlates with the test accuracy of convolutional neural networks (CNN). The CSG measure is derived from the probabilistic divergence between classes in a spectral clustering framework. We show that this metric correlates with the overall separability of the dataset and thus its inherent complexity. As will be shown, our metric can be used for dataset reduction, to assess which classes are more difficult to disentangle, and approximate the accuracy one could expect to get with a CNN. Results obtained on 11 datasets and three CNN models reveal that our method is more accurate and faster than previous complexity measures.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/25/2021

Hyperspectral Image Classification: Artifacts of Dimension Reduction on Hybrid CNN

Convolutional Neural Networks (CNN) has been extensively studied for Hyp...
research
09/29/2022

Dataset Complexity Assessment Based on Cumulative Maximum Scaled Area Under Laplacian Spectrum

Dataset complexity assessment aims to predict classification performance...
research
05/23/2019

Some limitations of norm based generalization bounds in deep neural networks

Deep convolutional neural networks have been shown to be able to fit a l...
research
01/24/2023

1D Convolutional neural networks and machine learning algorithms for spectral data classification with a case study for Covid-19

Machine and deep learning algorithms have increasingly been applied to s...
research
10/25/2020

Applying convolutional neural networks to extremely sparse image datasets using an image subdivision approach

Purpose: The aim of this work is to demonstrate that convolutional neura...
research
06/14/2018

SCSP: Spectral Clustering Filter Pruning with Soft Self-adaption Manners

Deep Convolutional Neural Networks (CNN) has achieved significant succes...
research
08/26/2020

NASirt: AutoML based learning with instance-level complexity information

Designing adequate and precise neural architectures is a challenging tas...

Please sign up or login with your details

Forgot password? Click here to reset