Exploring the Entire Regularization Path for the Asymmetric Cost Linear Support Vector Machine

10/12/2016
by   Daniel Wesierski, et al.
0

We propose an algorithm for exploring the entire regularization path of asymmetric-cost linear support vector machines. Empirical evidence suggests the predictive power of support vector machines depends on the regularization parameters of the training algorithms. The algorithms exploring the entire regularization paths have been proposed for single-cost support vector machines thereby providing the complete knowledge on the behavior of the trained model over the hyperparameter space. Considering the problem in two-dimensional hyperparameter space though enables our algorithm to maintain greater flexibility in dealing with special cases and sheds light on problems encountered by algorithms building the paths in one-dimensional spaces. We demonstrate two-dimensional regularization paths for linear support vector machines that we train on synthetic and real data.

READ FULL TEXT
research
08/14/2023

Algorithms for the Training of Neural Support Vector Machines

Neural support vector machines (NSVMs) allow for the incorporation of do...
research
03/27/2009

An Exponential Lower Bound on the Complexity of Regularization Paths

For a variety of regularized optimization problems in machine learning, ...
research
07/18/2017

Bayesian Nonlinear Support Vector Machines for Big Data

We propose a fast inference method for Bayesian nonlinear support vector...
research
11/08/2011

On the stability of bootstrap estimators

It is shown that bootstrap approximations of an estimator which is based...
research
07/05/2016

An Aggregate and Iterative Disaggregate Algorithm with Proven Optimality in Machine Learning

We propose a clustering-based iterative algorithm to solve certain optim...
research
01/05/2021

Learning Sign-Constrained Support Vector Machines

Domain knowledge is useful to improve the generalization performance of ...
research
04/26/2022

Automatic Monitoring of Fruit Ripening Rooms by UHF RFID Sensor Network and Machine Learning

Accelerated ripening through the exposure of fruits to controlled enviro...

Please sign up or login with your details

Forgot password? Click here to reset