The Random Forest Kernel and other kernels for big data from random partitions

02/18/2014
by   Alex Davies, et al.
0

We present Random Partition Kernels, a new class of kernels derived by demonstrating a natural connection between random partitions of objects and kernels between those objects. We show how the construction can be used to create kernels from methods that would not normally be viewed as random partitions, such as Random Forest. To demonstrate the potential of this method, we propose two new kernels, the Random Forest Kernel and the Fast Cluster Kernel, and show that these kernels consistently outperform standard kernels on problems involving real-world datasets. Finally, we show how the form of these kernels lend themselves to a natural approximation that is appropriate for certain big data problems, allowing O(N) inference in methods such as Gaussian Processes, Support Vector Machines and Kernel PCA.

READ FULL TEXT
research
12/14/2018

Making Sense of Random Forest Probabilities: a Kernel Perspective

A random forest is a popular tool for estimating probabilities in machin...
research
10/25/2022

An approach to the Gaussian RBF kernels via Fock spaces

We use methods from the Fock space and Segal-Bargmann theories to prove ...
research
02/07/2022

Random Gegenbauer Features for Scalable Kernel Methods

We propose efficient random features for approximating a new and rich cl...
research
01/28/2019

Support Feature Machines

Support Vector Machines (SVMs) with various kernels have played dominant...
research
08/31/2020

Random Forest (RF) Kernel for Regression, Classification and Survival

Breiman's random forest (RF) can be interpreted as an implicit kernel ge...
research
02/21/2021

Tractable Computation of Expected Kernels by Circuits

Computing the expectation of some kernel function is ubiquitous in machi...
research
04/15/2023

Efficient Convex Algorithms for Universal Kernel Learning

The accuracy and complexity of machine learning algorithms based on kern...

Please sign up or login with your details

Forgot password? Click here to reset