Entropy-based closure for probabilistic learning on manifolds

03/21/2018
by   C. Soizea, et al.
0

In a recent paper, the authors proposed a general methodology for probabilistic learning on manifolds. The method was used to generate numerical samples that are statistically consistent with an existing dataset construed as a realization from a non-Gaussian random vector. The manifold structure is learned using diffusion manifolds and the statistical sample generation is accomplished using a projected Ito stochastic differential equation. This probabilistic learning approach has been extended to polynomial chaos representation of databases on manifolds and to probabilistic nonconvex constrained optimization with a fixed budget of function evaluations. The methodology introduces an isotropic-diffusion kernel with hyperparameter ϵ. Currently, ϵ is more or less arbitrarily chosen. In this paper, we propose a selection criterion for identifying an optimal value of ϵ, based on a maximum entropy argument. The result is a comprehensive, closed, probabilistic model for characterizing data sets with hidden constraints. This entropy argument ensures that out of all possible models, this is the one that is the most uncertain beyond any specified constraints, which is selected. Applications are presented for several databases.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

02/28/2020

Probabilistic Learning on Manifolds

This paper presents mathematical results in support of the methodology o...
02/20/2022

Pseudo Numerical Methods for Diffusion Models on Manifolds

Denoising Diffusion Probabilistic Models (DDPMs) can generate high-quali...
10/27/2020

Probabilistic learning on manifolds constrained by nonlinear partial differential equations for small datasets

A novel extension of the Probabilistic Learning on Manifolds (PLoM) is p...
02/22/2021

Probabilistic Learning on Manifolds (PLoM) with Partition

The probabilistic learning on manifolds (PLoM) introduced in 2016 has so...
10/28/2019

Sampling of Bayesian posteriors with a non-Gaussian probabilistic learning on manifolds from a small dataset

This paper tackles the challenge presented by small-data to the task of ...
05/25/2021

Prediction error quantification through probabilistic scaling – EXTENDED VERSION

In this paper, we address the probabilistic error quantification of a ge...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.