Regularization for Multiple Kernel Learning via Sum-Product Networks

02/13/2014
by   Ziming Zhang, et al.
0

In this paper, we are interested in constructing general graph-based regularizers for multiple kernel learning (MKL) given a structure which is used to describe the way of combining basis kernels. Such structures are represented by sum-product networks (SPNs) in our method. Accordingly we propose a new convex regularization method for MLK based on a path-dependent kernel weighting function which encodes the entire SPN structure in our method. Under certain conditions and from the view of probability, this function can be considered to follow multinomial distributions over the weights associated with product nodes in SPNs. We also analyze the convexity of our regularizer and the complexity of our induced classifiers, and further propose an efficient wrapper algorithm to optimize our formulation. In our experiments, we apply our method to ......

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/11/2021

Kernel Learning For Sound Field Estimation With L1 and L2 Regularizations

A method to estimate an acoustic field from discrete microphone measurem...
research
09/28/2009

SpicyMKL

We propose a new optimization algorithm for Multiple Kernel Learning (MK...
research
01/25/2019

On the Statistical Efficiency of Optimal Kernel Sum Classifiers

We propose a novel combination of optimization tools with learning theor...
research
09/22/2017

Total stability of kernel methods

Regularized empirical risk minimization using kernels and their correspo...
research
11/02/2018

An L1 Representer Theorem for Multiple-Kernel Regression

The theory of RKHS provides an elegant framework for supervised learning...
research
03/05/2019

Learning a smooth kernel regularizer for convolutional neural networks

Modern deep neural networks require a tremendous amount of data to train...
research
06/27/2018

TopoReg: A Topological Regularizer for Classifiers

Regularization plays a crucial role in supervised learning. A successful...

Please sign up or login with your details

Forgot password? Click here to reset