AI Chat AI Image Generator AI Video Text to Speech

Maximum Entropy and the Glasses You Are Looking Through

01/16/2013

∙

by Peter D. Grünwald, et al.

∙

∙

We give an interpretation of the Maximum Entropy (MaxEnt) Principle in game-theoretic terms. Based on this interpretation, we make a formal distinction between different ways of em applying/ Maximum Entropy distributions. MaxEnt has frequently been criticized on the grounds that it leads to highly representation dependent results. Our distinction allows us to avoid this problem in many cases.

page 1

page 2

page 3

page 4

research

∙ 07/11/2012

The Minimum Information Principle for Discriminative Learning

Exponential models of distributions are widely used in machine learning ...

0 Amir Globerson, et al. ∙

research

∙ 07/12/2016

Approximate maximum entropy principles via Goemans-Williamson with applications to provable variational methods

The well known maximum-entropy principle due to Jaynes, which states tha...

0 Yuanzhi Li, et al. ∙

research

∙ 10/19/2012

Boltzmann Machine Learning with the Latent Maximum Entropy Principle

We present a new statistical learning paradigm for Boltzmann machines ba...

0 Shaojun Wang, et al. ∙

research

∙ 09/09/2021

Notes on Generalizing the Maximum Entropy Principle to Uncertain Data

The principle of maximum entropy is a broadly applicable technique for c...

0 Kenneth Bogert, et al. ∙

research

∙ 08/21/2023

Information content and maximum entropy of compartmental systems in equilibrium

Although compartmental dynamical systems are used in many different area...

0 Holger Metzler, et al. ∙

research

∙ 11/28/2021

On Thermodynamic Interpretation of Copula Entropy

Copula Entropy (CE) is a recently introduced concept for measuring corre...

0 Jian Ma, et al. ∙

research

∙ 10/28/2020

Three Applications of Entropy to Gerrymandering

This preprint is an exploration in how a single mathematical idea - entr...

0 Larry Guth, et al. ∙