Dual-to-kernel learning with ideals

02/01/2014
by   Franz J Király, et al.
0

In this paper, we propose a theory which unifies kernel learning and symbolic algebraic methods. We show that both worlds are inherently dual to each other, and we use this duality to combine the structure-awareness of algebraic methods with the efficiency and generality of kernels. The main idea lies in relating polynomial rings to feature space, and ideals to manifolds, then exploiting this generative-discriminative duality on kernel matrices. We illustrate this by proposing two algorithms, IPCA and AVICA, for simultaneous manifold and feature learning, and test their accuracy on synthetic and real world data.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/18/2016

Generalized support vector regression: duality and tensor-kernel representation

In this paper we study the variational problem associated to support vec...
research
08/23/2023

Duality for Clans: a Refinement of Gabriel-Ulmer Duality

Clans are representations of generalized algebraic theories that contain...
research
03/08/2019

Large-Margin Multiple Kernel Learning for Discriminative Features Selection and Representation Learning

Multiple kernel learning (MKL) algorithms combine different base kernels...
research
08/06/2018

Semblance: A Rank-Based Kernel on Probability Spaces for Niche Detection

Kernel methods provide a principled approach for detecting nonlinear rel...
research
02/04/2020

Robust Generative Restricted Kernel Machines using Weighted Conjugate Feature Duality

In the past decade, interest in generative models has grown tremendously...
research
06/12/2023

Nonlinear SVD with Asymmetric Kernels: feature learning and asymmetric Nyström method

Asymmetric data naturally exist in real life, such as directed graphs. D...
research
12/30/2020

Commutative Information Algebras: Representation and Duality Theory

Information algebras arise from the idea that information comes in piece...

Please sign up or login with your details

Forgot password? Click here to reset