Off-the-grid: Fast and Effective Hyperparameter Search for Kernel Clustering

06/24/2020
by   Bruno Ordozgoiti, et al.
0

Kernel functions are a powerful tool to enhance the k-means clustering algorithm via the kernel trick. It is known that the parameters of the chosen kernel function can have a dramatic impact on the result. In supervised settings, these can be tuned via cross-validation, but for clustering this is not straightforward and heuristics are usually employed. In this paper we study the impact of kernel parameters on kernel k-means. In particular, we derive a lower bound, tight up to constant factors, below which the parameter of the RBF kernel will render kernel k-means meaningless. We argue that grid search can be ineffective for hyperparameter search in this context and propose an alternative algorithm for this purpose. In addition, we offer an efficient implementation based on fast approximate exponentiation with provable quality guarantees. Our experimental results demonstrate the ability of our method to efficiently reveal a rich and useful set of hyperparameter values.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/15/2019

Tight Kernel Query Complexity of Kernel Ridge Regression and Kernel k-means Clustering

We present tight lower bounds on the number of kernel evaluations requir...
research
01/19/2017

On the Existence of Kernel Function for Kernel-Trick of k-Means

This paper corrects the proof of the Theorem 2 from the Gower's paper [p...
research
01/19/2023

Data-driven kernel designs for optimized greedy schemes: A machine learning perspective

Thanks to their easy implementation via Radial Basis Functions (RBFs), m...
research
05/11/2020

SimpleMKKM: Simple Multiple Kernel K-means

We propose a simple yet effective multiple kernel clustering algorithm, ...
research
03/09/2020

Nearly Optimal Risk Bounds for Kernel K-Means

In this paper, we study the statistical properties of the kernel k-means...
research
08/25/2021

Applying Semi-Automated Hyperparameter Tuning for Clustering Algorithms

When approaching a clustering problem, choosing the right clustering alg...
research
11/27/2019

K-MACE and Kernel K-MACE Clustering

Determining the correct number of clusters (CNC) is an important task in...

Please sign up or login with your details

Forgot password? Click here to reset