Probability Update: Conditioning vs. Cross-Entropy

02/06/2013
by   Adam J. Grove, et al.
0

Conditioning is the generally agreed-upon method for updating probability distributions when one learns that an event is certainly true. But it has been argued that we need other rules, in particular the rule of cross-entropy minimization, to handle updates that involve uncertain information. In this paper we re-examine such a case: van Fraassen's Judy Benjamin problem, which in essence asks how one might update given the value of a conditional probability. We argue that -- contrary to the suggestions in the literature -- it is possible to use simple conditionalization in this case, and thereby obtain answers that agree fully with intuition. This contrasts with proposals such as cross-entropy, which are easier to apply but can give unsatisfactory answers. Based on the lessons from this example, we speculate on some general philosophical issues concerning probability update.

READ FULL TEXT

page 1

page 3

page 4

research
03/27/2013

Evaluation of Uncertain Inference Models I: PROSPECTOR

This paper examines the accuracy of the PROSPECTOR model for uncertain r...
research
06/28/2022

On the Rényi Cross-Entropy

The Rényi cross-entropy measure between two distributions, a generalizat...
research
07/27/2014

Updating Probabilities

As examples such as the Monty Hall puzzle show, applying conditioning to...
research
12/21/2020

Improvement of the cross-entropy method in high dimension through a one-dimensional projection without gradient estimation

Rare event probability estimation is an important topic in reliability a...
research
12/04/2018

Set Cross Entropy: Likelihood-based Permutation Invariant Loss Function for Probability Distributions

We propose a permutation-invariant loss function designed for the neural...
research
11/17/2022

Bayesian improved cross entropy method for network reliability assessment

We propose a modification of the improved cross entropy (iCE) method to ...
research
09/16/2006

Cross-Entropy method: convergence issues for extended implementation

The cross-entropy method (CE) developed by R. Rubinstein is an elegant p...

Please sign up or login with your details

Forgot password? Click here to reset