DeepAI AI Chat
Log In Sign Up

Regularized Maximum Likelihood for Intrinsic Dimension Estimation

by   Mithun Das Gupta, et al.

We propose a new method for estimating the intrinsic dimension of a dataset by applying the principle of regularized maximum likelihood to the distances between close neighbors. We propose a regularization scheme which is motivated by divergence minimization principles. We derive the estimator by a Poisson process approximation, argue about its convergence properties and apply it to a number of simulated and real datasets. We also show it has the best overall performance compared with two other intrinsic dimension estimators.


Geometry-Aware Maximum Likelihood Estimation of Intrinsic Dimension

The existing approaches to intrinsic dimension estimation usually are no...

Distributional Results for Model-Based Intrinsic Dimension Estimators

Modern datasets are characterized by a large number of features that may...

Regularized Maximum Likelihood Estimation for the Random Coefficients Model

The random coefficients model Y_i=β_0_i+β_1_i X_1_i+β_2_i X_2_i+…+β_d_i ...

Bias-corrected estimator for intrinsic dimension and differential entropy–a visual multiscale approach

Intrinsic dimension and differential entropy estimators are studied in t...

Manifold-adaptive dimension estimation revisited

Data dimensionality informs us about data complexity and sets limit on t...

Consistency and Computation of Regularized MLEs for Multivariate Hawkes Processes

This paper proves the consistency property for the regularized maximum l...

intRinsic: an R package for model-based estimation of the intrinsic dimension of a dataset

The estimation of the intrinsic dimension of a dataset is a fundamental ...