DeepAI AI Chat
Log In Sign Up

Geometry-Aware Maximum Likelihood Estimation of Intrinsic Dimension

04/12/2019
by   Marina Gomtsyan, et al.
0

The existing approaches to intrinsic dimension estimation usually are not reliable when the data are nonlinearly embedded in the high dimensional space. In this work, we show that the explicit accounting to geometric properties of unknown support leads to the polynomial correction to the standard maximum likelihood estimate of intrinsic dimension for flat manifolds. The proposed algorithm (GeoMLE) realizes the correction by regression of standard MLEs based on distances to nearest neighbors for different sizes of neighborhoods. Moreover, the proposed approach also efficiently handles the case of nonuniform sampling of the manifold. We perform numerous experiments on different synthetic and real-world datasets. The results show that our algorithm achieves state-of-the-art performance, while also being computationally efficient and robust to noise in the data.

READ FULL TEXT

page 1

page 2

page 3

page 4

03/15/2012

Regularized Maximum Likelihood for Intrinsic Dimension Estimation

We propose a new method for estimating the intrinsic dimension of a data...
04/30/2020

Bias-corrected estimator for intrinsic dimension and differential entropy–a visual multiscale approach

Intrinsic dimension and differential entropy estimators are studied in t...
10/31/2022

Study of Manifold Geometry using Multiscale Non-Negative Kernel Graphs

Modern machine learning systems are increasingly trained on large amount...
08/07/2020

Manifold-adaptive dimension estimation revisited

Data dimensionality informs us about data complexity and sets limit on t...
06/29/2022

LIDL: Local Intrinsic Dimension Estimation Using Approximate Likelihood

Most of the existing methods for estimating the local intrinsic dimensio...
04/28/2021

Distributional Results for Model-Based Intrinsic Dimension Estimators

Modern datasets are characterized by a large number of features that may...
09/04/2022

Incremental maximum likelihood estimation for efficient adaptive filtering

Adaptive filtering is a well-known problem with a wide range of applicat...

Code Repositories

GeoMLE

This repo contains code for GeoMLE intrinsic dimension estimation algorithm


view repo