DeepAI AI Chat
Log In Sign Up

Bias-corrected estimator for intrinsic dimension and differential entropy–a visual multiscale approach

04/30/2020
by   Jugurta Montalvão, et al.
0

Intrinsic dimension and differential entropy estimators are studied in this paper, including their systematic bias. A pragmatic approach for joint estimation and bias correction of these two fundamental measures is proposed. Shared steps on both estimators are highlighted, along with their useful consequences to data analysis. It is shown that both estimators can be complementary parts of a single approach, and that the simultaneous estimation of differential entropy and intrinsic dimension give meaning to each other, where estimates at different observation scales convey different perspectives of underlying manifolds. Experiments with synthetic and real datasets are presented to illustrate how to extract meaning from visual inspections, and how to compensate for biases.

READ FULL TEXT

page 1

page 2

page 3

page 4

04/12/2019

Geometry-Aware Maximum Likelihood Estimation of Intrinsic Dimension

The existing approaches to intrinsic dimension estimation usually are no...
03/15/2012

Regularized Maximum Likelihood for Intrinsic Dimension Estimation

We propose a new method for estimating the intrinsic dimension of a data...
08/26/2020

Improved estimators in beta prime regression models

In this paper, we consider the beta prime regression model recently prop...
10/30/2020

Bias-Corrected Crosswise Estimators for Sensitive Inquiries

The crosswise model is an increasingly popular survey technique to elici...
04/19/2023

Entropy Estimation via Uniformization

Entropy estimation is of practical importance in information theory and ...
08/07/2020

Manifold-adaptive dimension estimation revisited

Data dimensionality informs us about data complexity and sets limit on t...
10/13/2022

An Additive Autoencoder for Dimension Estimation

An additive autoencoder for dimension reduction, which is composed of a ...