MKL-RT: Multiple Kernel Learning for Ratio-trace Problems via Convex Optimization

10/16/2014
by   Raviteja Vemulapalli, et al.
0

In the recent past, automatic selection or combination of kernels (or features) based on multiple kernel learning (MKL) approaches has been receiving significant attention from various research communities. Though MKL has been extensively studied in the context of support vector machines (SVM), it is relatively less explored for ratio-trace problems. In this paper, we show that MKL can be formulated as a convex optimization problem for a general class of ratio-trace problems that encompasses many popular algorithms used in various computer vision applications. We also provide an optimization procedure that is guaranteed to converge to the global optimum of the proposed optimization problem. We experimentally demonstrate that the proposed MKL approach, which we refer to as MKL-RT, can be successfully used to select features for discriminative dimensionality reduction and cross-modal retrieval. We also show that the proposed convex MKL-RT approach performs better than the recently proposed non-convex MKL-DR approach.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/26/2020

About the Non-Convex Optimization Problem Induced by Non-positive Semidefinite Kernel Learning

During the last years, kernel based methods proved to be very successful...
research
06/28/2023

Non-Convex Optimizations for Machine Learning with Theoretical Guarantee: Robust Matrix Completion and Neural Network Learning

Despite the recent development in machine learning, most learning system...
research
06/16/2021

Non-PSD Matrix Sketching with Applications to Regression and Optimization

A variety of dimensionality reduction techniques have been applied for c...
research
10/27/2016

A Category Space Approach to Supervised Dimensionality Reduction

Supervised dimensionality reduction has emerged as an important theme in...
research
05/04/2018

A Convex Approximation of the Relaxed Binaural Beamforming Optimization Problem

The recently proposed relaxed binaural beamforming (RBB) optimization pr...
research
10/27/2018

Using Fractional Programming for Zero-Norm Approximation

This paper proposes the use of fractional programming (FP) to solve prob...
research
04/15/2023

Efficient Convex Algorithms for Universal Kernel Learning

The accuracy and complexity of machine learning algorithms based on kern...

Please sign up or login with your details

Forgot password? Click here to reset