DeepAI AI Chat
Log In Sign Up

Bias-corrected estimator for intrinsic dimension and differential entropy–a visual multiscale approach

by   Jugurta Montalvão, et al.

Intrinsic dimension and differential entropy estimators are studied in this paper, including their systematic bias. A pragmatic approach for joint estimation and bias correction of these two fundamental measures is proposed. Shared steps on both estimators are highlighted, along with their useful consequences to data analysis. It is shown that both estimators can be complementary parts of a single approach, and that the simultaneous estimation of differential entropy and intrinsic dimension give meaning to each other, where estimates at different observation scales convey different perspectives of underlying manifolds. Experiments with synthetic and real datasets are presented to illustrate how to extract meaning from visual inspections, and how to compensate for biases.


page 1

page 2

page 3

page 4


Geometry-Aware Maximum Likelihood Estimation of Intrinsic Dimension

The existing approaches to intrinsic dimension estimation usually are no...

Regularized Maximum Likelihood for Intrinsic Dimension Estimation

We propose a new method for estimating the intrinsic dimension of a data...

Improved estimators in beta prime regression models

In this paper, we consider the beta prime regression model recently prop...

Bias-Corrected Crosswise Estimators for Sensitive Inquiries

The crosswise model is an increasingly popular survey technique to elici...

Entropy Estimation via Uniformization

Entropy estimation is of practical importance in information theory and ...

Manifold-adaptive dimension estimation revisited

Data dimensionality informs us about data complexity and sets limit on t...

An Additive Autoencoder for Dimension Estimation

An additive autoencoder for dimension reduction, which is composed of a ...