Entropy-based closure for probabilistic learning on manifolds

by   C. Soizea, et al.

In a recent paper, the authors proposed a general methodology for probabilistic learning on manifolds. The method was used to generate numerical samples that are statistically consistent with an existing dataset construed as a realization from a non-Gaussian random vector. The manifold structure is learned using diffusion manifolds and the statistical sample generation is accomplished using a projected Ito stochastic differential equation. This probabilistic learning approach has been extended to polynomial chaos representation of databases on manifolds and to probabilistic nonconvex constrained optimization with a fixed budget of function evaluations. The methodology introduces an isotropic-diffusion kernel with hyperparameter ϵ. Currently, ϵ is more or less arbitrarily chosen. In this paper, we propose a selection criterion for identifying an optimal value of ϵ, based on a maximum entropy argument. The result is a comprehensive, closed, probabilistic model for characterizing data sets with hidden constraints. This entropy argument ensures that out of all possible models, this is the one that is the most uncertain beyond any specified constraints, which is selected. Applications are presented for several databases.



There are no comments yet.


page 1

page 2

page 3

page 4


Probabilistic Learning on Manifolds

This paper presents mathematical results in support of the methodology o...

Pseudo Numerical Methods for Diffusion Models on Manifolds

Denoising Diffusion Probabilistic Models (DDPMs) can generate high-quali...

Probabilistic learning on manifolds constrained by nonlinear partial differential equations for small datasets

A novel extension of the Probabilistic Learning on Manifolds (PLoM) is p...

Probabilistic Learning on Manifolds (PLoM) with Partition

The probabilistic learning on manifolds (PLoM) introduced in 2016 has so...

Sampling of Bayesian posteriors with a non-Gaussian probabilistic learning on manifolds from a small dataset

This paper tackles the challenge presented by small-data to the task of ...

Prediction error quantification through probabilistic scaling – EXTENDED VERSION

In this paper, we address the probabilistic error quantification of a ge...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.