Linear Support Vector Regression with Linear Constraints

11/06/2019
by   Quentin Klopfenstein, et al.
0

This paper studies the addition of linear constraints to the Support Vector Regression (SVR) when the kernel is linear. Adding those constraints into the problem allows to add prior knowledge on the estimator obtained, such as finding probability vector or monotone data. We propose a generalization of the Sequential Minimal Optimization (SMO) algorithm for solving the optimization problem with linear constraints and prove its convergence. Then, practical performances of this estimator are shown on simulated and real datasets with different settings: non negative regression, regression onto the simplex for biomedical data and isotonic regression for weather forecast.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/05/2019

Maximal Margin Distribution Support Vector Regression with coupled Constraints-based Convex Optimization

Support vector regression (SVR) is one of the most popular machine learn...
research
09/10/2015

An Epsilon Hierarchical Fuzzy Twin Support Vector Regression

The research presents epsilon hierarchical fuzzy twin support vector reg...
research
05/21/2021

A Precise Performance Analysis of Support Vector Regression

In this paper, we study the hard and soft support vector regression tech...
research
03/09/2020

A working likelihood approach to support vector regression with a data-driven insensitivity parameter

The insensitive parameter in support vector regression determines the se...
research
04/13/2020

Scenario optimization with relaxation: a new tool for design and application to machine learning problems

Scenario optimization is by now a well established technique to perform ...
research
02/06/2021

Linear Matrix Inequality Approaches to Koopman Operator Approximation

The regression problem associated with finding a matrix approximation of...
research
03/16/2018

Sufficient Conditions for a Linear Estimator to be a Local Polynomial Regression

It is shown that any linear estimator that satisfies the moment conditio...

Please sign up or login with your details

Forgot password? Click here to reset