Learning with Asymmetric Kernels: Least Squares and Feature Interpretation

02/03/2022
by   Mingzhen He, et al.
0

Asymmetric kernels naturally exist in real life, e.g., for conditional probability and directed graphs. However, most of the existing kernel-based learning methods require kernels to be symmetric, which prevents the use of asymmetric kernels. This paper addresses the asymmetric kernel-based learning in the framework of the least squares support vector machine named AsK-LS, resulting in the first classification method that can utilize asymmetric kernels directly. We will show that AsK-LS can learn with asymmetric features, namely source and target features, while the kernel trick remains applicable, i.e., the source and target features exist but are not necessarily known. Besides, the computational burden of AsK-LS is as cheap as dealing with symmetric kernels. Experimental results on the Corel database, directed graphs, and the UCI database will show that in the case asymmetric information is crucial, the proposed AsK-LS can learn with asymmetric kernels and performs much better than the existing kernel methods that have to do symmetrization to accommodate asymmetric kernels.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/12/2023

Nonlinear SVD with Asymmetric Kernels: feature learning and asymmetric Nyström method

Asymmetric data naturally exist in real life, such as directed graphs. D...
research
09/18/2022

Random Fourier Features for Asymmetric Kernels

The random Fourier features (RFFs) method is a powerful and popular tech...
research
02/24/2017

Learning Rates for Kernel-Based Expectile Regression

Conditional expectiles are becoming an increasingly important tool in fi...
research
10/21/2014

On Symmetric and Asymmetric LSHs for Inner Product Search

We consider the problem of designing locality sensitive hashes (LSH) for...
research
07/08/2015

Shedding Light on the Asymmetric Learning Capability of AdaBoost

In this paper, we propose a different insight to analyze AdaBoost. This ...
research
01/16/2023

Krylov subspace methods to accelerate kernel machines on graphs

In classical frameworks as the Euclidean space, positive definite kernel...
research
09/06/2023

The Case for Asymmetric Systolic Array Floorplanning

The widespread proliferation of deep learning applications has triggered...

Please sign up or login with your details

Forgot password? Click here to reset