L^3-SVMs: Landmarks-based Linear Local Support Vectors Machines

03/01/2017
by   Valentina Zantedeschi, et al.
0

For their ability to capture non-linearities in the data and to scale to large training sets, local Support Vector Machines (SVMs) have received a special attention during the past decade. In this paper, we introduce a new local SVM method, called L^3-SVMs, which clusters the input space, carries out dimensionality reduction by projecting the data on landmarks, and jointly learns a linear combination of local models. Simple and effective, our algorithm is also theoretically well-founded. Using the framework of Uniform Stability, we show that our SVM formulation comes with generalization guarantees on the true risk. The experiments based on the simplest configuration of our model (i.e. landmarks randomly selected, linear projection, linear kernel) show that L^3-SVMs is very competitive w.r.t. the state of the art and opens the door to new exciting lines of research.

READ FULL TEXT
research
09/14/2013

Local Support Vector Machines:Formulation and Analysis

We provide a formulation for Local Support Vector Machines (LSVMs) that ...
research
09/27/2010

General Scaled Support Vector Machines

Support Vector Machines (SVMs) are popular tools for data mining tasks s...
research
07/21/2020

A Semismooth-Newton's-Method-Based Linearization and Approximation Approach for Kernel Support Vector Machines

Support Vector Machines (SVMs) are among the most popular and the best p...
research
01/11/2017

A Large Dimensional Analysis of Least Squares Support Vector Machines

In this article, a large dimensional performance analysis of kernel leas...
research
12/15/2005

Evolino for recurrent support vector machines

Traditional Support Vector Machines (SVMs) need pre-wired finite time wi...
research
03/11/2015

Diverse Landmark Sampling from Determinantal Point Processes for Scalable Manifold Learning

High computational costs of manifold learning prohibit its application f...
research
08/21/2020

Defending Distributed Classifiers Against Data Poisoning Attacks

Support Vector Machines (SVMs) are vulnerable to targeted training data ...

Please sign up or login with your details

Forgot password? Click here to reset