Efficient Information Theoretic Clustering on Discrete Lattices

10/26/2013
by   Christian Bauckhage, et al.
0

We consider the problem of clustering data that reside on discrete, low dimensional lattices. Canonical examples for this setting are found in image segmentation and key point extraction. Our solution is based on a recent approach to information theoretic clustering where clusters result from an iterative procedure that minimizes a divergence measure. We replace costly processing steps in the original algorithm by means of convolutions. These allow for highly efficient implementations and thus significantly reduce runtime. This paper therefore bridges a gap between machine learning and signal processing.

READ FULL TEXT

page 3

page 5

page 7

research
02/04/2021

Undecidability of Underfitting in Learning Algorithms

Using recent machine learning results that present an information-theore...
research
10/12/2020

An Information-Theoretic Perspective on Overfitting and Underfitting

We present an information-theoretic framework for understanding overfitt...
research
01/31/2023

Bayesian estimation of information-theoretic metrics for sparsely sampled distributions

Estimating the Shannon entropy of a discrete distribution from which we ...
research
02/15/2022

Information-Theoretic Analysis of Minimax Excess Risk

Two main concepts studied in machine learning theory are generalization ...
research
05/01/2023

Exactly Tight Information-Theoretic Generalization Error Bound for the Quadratic Gaussian Problem

We provide a new information-theoretic generalization error bound that i...
research
09/05/2021

Nonparametric Extrema Analysis in Time Series for Envelope Extraction, Peak Detection and Clustering

In this paper, we propose a nonparametric approach that can be used in e...
research
10/10/2018

Probabilistic Clustering Using Maximal Matrix Norm Couplings

In this paper, we present a local information theoretic approach to expl...

Please sign up or login with your details

Forgot password? Click here to reset