Teaching decision theory proof strategies using a crowdsourcing problem

05/19/2019
by   Luis G. Esteves, et al.
1

Teaching how to derive minimax decision rules can be challenging because of the lack of examples that are simple enough to be used in the classroom. Motivated by this challenge, we provide a new example that illustrates the use of standard techniques in the derivation of optimal decision rules under the Bayes and minimax approaches. We discuss how to predict the value of an unknown quantity, θ∈{0,1}, given the opinions of n experts. An important example of such crowdsourcing problem occurs in modern cosmology, where θ indicates whether a given galaxy is merging or not, and Y_1, ..., Y_n are the opinions from n astronomers regarding θ. We use the obtained prediction rules to discuss advantages and disadvantages of the Bayes and minimax approaches to decision theory. The material presented here is intended to be taught to first-year graduate students.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/27/2020

Iterative Machine Teaching without Teachers

Iterative machine teaching is a method for selecting an optimal teaching...
research
01/15/2015

PAC-Bayes with Minimax for Confidence-Rated Transduction

We consider using an ensemble of binary classifiers for transductive pre...
research
10/04/2016

Towards the Design of Prospect-Theory based Human Decision Rules for Hypothesis Testing

Detection rules have traditionally been designed for rational agents tha...
research
02/13/2018

Analysis of Minimax Error Rate for Crowdsourcing and Its Application to Worker Clustering Model

While crowdsourcing has become an important means to label data, crowdwo...
research
12/10/2014

Generalised Entropy MDPs and Minimax Regret

Bayesian methods suffer from the problem of how to specify prior beliefs...
research
11/24/2017

Strategies for basing the CS theory course on non-decision problems

Computational and complexity theory are core components of the computer ...
research
07/02/2019

The Ethical Dilemma when (not) Setting up Cost-based Decision Rules in Semantic Segmentation

Neural networks for semantic segmentation can be seen as statistical mod...

Please sign up or login with your details

Forgot password? Click here to reset