Conditions for Unnecessary Logical Constraints in Kernel Machines

08/31/2019
by   Francesco Giannini, et al.
0

A main property of support vector machines consists in the fact that only a small portion of the training data is significant to determine the maximum margin separating hyperplane in the feature space, the so called support vectors. In a similar way, in the general scheme of learning from constraints, where possibly several constraints are considered, some of them may turn out to be unnecessary with respect to the learning optimization, even if they are active for a given optimal solution. In this paper we extend the definition of support vector to support constraint and we provide some criteria to determine which constraints can be removed from the learning problem still yielding the same optimal solutions. In particular, we discuss the case of logical constraints expressed by Lukasiewicz logic, where both inferential and algebraic arguments can be considered. Some theoretical results that characterize the concept of unnecessary constraint are proved and explained by means of examples.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/04/2009

Qualitative Robustness of Support Vector Machines

Support vector machines have attracted much attention in theoretical and...
research
09/18/2018

On a Convex Logic Fragment for Learning and Reasoning

In this paper we introduce the convex fragment of Łukasiewicz Logic and ...
research
12/12/2019

Totally Deep Support Vector Machines

Support vector machines (SVMs) have been successful in solving many comp...
research
08/10/2020

Wikidata Constraints on MARS (Extended Technical Report)

Wikidata constraints, albeit useful, are represented and processed in an...
research
10/26/2020

About the Non-Convex Optimization Problem Induced by Non-positive Semidefinite Kernel Learning

During the last years, kernel based methods proved to be very successful...
research
11/26/2012

Random Projections for Linear Support Vector Machines

Let X be a data matrix of rank ρ, whose rows represent n points in d-dim...
research
04/22/2020

Eigendecomposition of Q in Equally Constrained Quadratic Programming

When applying eigenvalue decomposition on the quadratic term matrix in a...

Please sign up or login with your details

Forgot password? Click here to reset