Very Simple Classifier: a Concept Binary Classifier toInvestigate Features Based on Subsampling and Localility

09/14/2016
by   Luca Masera, et al.
0

We propose Very Simple Classifier (VSC) a novel method designed to incorporate the concepts of subsampling and locality in the definition of features to be used as the input of a perceptron. The rationale is that locality theoretically guarantees a bound on the generalization error. Each feature in VSC is a max-margin classifier built on randomly-selected pairs of samples. The locality in VSC is achieved by multiplying the value of the feature by a confidence measure that can be characterized in terms of the Chebichev inequality. The output of the layer is then fed in a output layer of neurons. The weights of the output layer are then determined by a regularized pseudoinverse. Extensive comparison of VSC against 9 competitors in the task of binary classification is carried out. Results on 22 benchmark datasets with fixed parameters show that VSC is competitive with the Multi Layer Perceptron (MLP) and outperforms the other competitors. An exploration of the parameter space shows VSC can outperform MLP.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/11/2020

Linear Dilation-Erosion Perceptron for Binary Classification

In this work, we briefly revise the reduced dilation-erosion perceptron ...
research
07/02/2022

Parameter efficient dendritic-tree neurons outperform perceptrons

Biological neurons are more powerful than artificial perceptrons, in par...
research
07/28/2014

Dynamic Feature Scaling for Online Learning of Binary Classifiers

Scaling feature values is an important step in numerous machine learning...
research
02/22/2023

A Generalized Weighted Loss for SVC and MLP

Usually standard algorithms employ a loss where each error is the mere a...
research
05/16/2022

Binarizing by Classification: Is soft function really necessary?

Binary neural network leverages the Sign function to binarize real value...
research
12/21/2021

RepMLPNet: Hierarchical Vision MLP with Re-parameterized Locality

Compared to convolutional layers, fully-connected (FC) layers are better...
research
12/02/2019

Capacity of the covariance perceptron

The classical perceptron is a simple neural network that performs a bina...

Please sign up or login with your details

Forgot password? Click here to reset