Selection of the Most Probable Best

07/15/2022
by   Taeho Kim, et al.
0

We consider an expected-value ranking and selection problem where all k solutions' simulation outputs depend on a common uncertain input model. Given that the uncertainty of the input model is captured by a probability simplex on a finite support, we define the most probable best (MPB) to be the solution whose probability of being optimal is the largest. To devise an efficient sampling algorithm to find the MPB, we first derive a lower bound to the large deviation rate of the probability of falsely selecting the MPB, then formulate an optimal computing budget allocation (OCBA) problem to find the optimal static sampling ratios for all solution-input model pairs that maximize the lower bound. We devise a series of sequential algorithms that apply interpretable and computationally efficient sampling rules and prove their sampling ratios achieve the optimality conditions for the OCBA problem as the simulation budget increases. The algorithms are benchmarked against a state-of-the-art sequential sampling algorithm designed for contextual ranking and selection problems and demonstrated to have superior empirical performances at finding the MPB.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/12/2023

Efficient Dynamic Allocation Policy for Robust Ranking and Selection under Stochastic Control Framework

This research considers the ranking and selection with input uncertainty...
research
01/09/2022

Selecting the Best Optimizing System

We formulate selecting the best optimizing system (SBOS) problems and pr...
research
04/24/2019

Efficient Simulation Budget Allocation for Subset Selection Using Regression Metamodels

This research considers the ranking and selection (R&S) problem of selec...
research
12/31/2020

Exploiting Transitivity for Top-k Selection with Score-Based Dueling Bandits

We consider the problem of top-k subset selection in Dueling Bandit prob...
research
11/27/2022

Convergence Rate Analysis for Optimal Computing Budget Allocation Algorithms

Ordinal optimization (OO) is a widely-studied technique for optimizing d...
research
10/07/2017

Ranking and Selection as Stochastic Control

Under a Bayesian framework, we formulate the fully sequential sampling a...
research
03/06/2023

The (Surprising) Rate Optimality of Greedy Procedures for Large-Scale Ranking and Selection

Large-scale ranking and selection (R S), which aims to select the best...

Please sign up or login with your details

Forgot password? Click here to reset