Exploring Maximum Entropy Distributions with Evolutionary Algorithms

02/05/2020
by   Raul Rojas, et al.
0

This paper shows how to evolve numerically the maximum entropy probability distributions for a given set of constraints, which is a variational calculus problem. An evolutionary algorithm can obtain approximations to some well-known analytical results, but is even more flexible and can find distributions for which a closed formula cannot be readily stated. The numerical approach handles distributions over finite intervals. We show that there are two ways of conducting the procedure: by direct optimization of the Lagrangian of the constrained problem, or by optimizing the entropy among the subset of distributions which fulfill the constraints. An incremental evolutionary strategy easily obtains the uniform, the exponential, the Gaussian, the log-normal, the Laplace, among other distributions, once the constrained problem is solved with any of the two methods. Solutions for mixed ("chimera") distributions can be also found. We explain why many of the distributions are symmetrical and continuous, but some are not.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/09/2022

The Elliptical Quartic Exponential Distribution: An Annular Distribution Obtained via Maximum Entropy

This paper describes the Elliptical Quartic Exponential distribution in ...
research
01/12/2017

Maximum Entropy Flow Networks

Maximum entropy modeling is a flexible and popular framework for formula...
research
06/23/2015

A Feature-Based Analysis on the Impact of Set of Constraints for e-Constrained Differential Evolution

Different types of evolutionary algorithms have been developed for const...
research
05/29/2023

Analysis of the (1+1) EA on LeadingOnes with Constraints

Understanding how evolutionary algorithms perform on constrained problem...
research
04/22/2018

Maximum entropy priors with derived parameters in a specified distribution

We propose a method for transforming probability distributions so that p...
research
08/11/2023

Gaussian Process Regression for Maximum Entropy Distribution

Maximum-Entropy Distributions offer an attractive family of probability ...
research
10/03/2022

Reconciling econometrics with continuous maximum-entropy models

In the study of economic networks, econometric approaches interpret the ...

Please sign up or login with your details

Forgot password? Click here to reset