Is margin preserved after random projection?

06/18/2012
by   Qinfeng Shi, et al.
0

Random projections have been applied in many machine learning algorithms. However, whether margin is preserved after random projection is non-trivial and not well studied. In this paper we analyse margin distortion after random projection, and give the conditions of margin preservation for binary classification problems. We also extend our analysis to margin for multiclass problems, and provide theoretical bounds on multiclass margin on the projected data.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/01/2021

Invariance principle of random projection for the norm

Johnson-Lindenstrauss guarantees certain topological structure is preser...
research
11/26/2012

Random Projections for Linear Support Vector Machines

Let X be a data matrix of rank ρ, whose rows represent n points in d-dim...
research
04/30/2012

A Conjugate Property between Loss Functions and Uncertainty Sets in Classification Problems

In binary classification problems, mainly two approaches have been propo...
research
11/21/2010

Random Projections for k-means Clustering

This paper discusses the topic of dimensionality reduction for k-means c...
research
02/03/2022

Multiclass learning with margin: exponential rates with no bias-variance trade-off

We study the behavior of error bounds for multiclass classification unde...
research
04/29/2022

On the Optimization of Margin Distribution

Margin has played an important role on the design and analysis of learni...
research
01/21/2021

Three-Dimensional Investigation of the Metric Properties of Parabolic Double Projection Involving Catadioptric Camera

This paper presents an analytical study for the metric properties of the...

Please sign up or login with your details

Forgot password? Click here to reset