Stopping Criterion Design for Recursive Bayesian Classification: Analysis and Decision Geometry

07/30/2020
by   Aziz Koçanaoğulları, et al.
7

Systems that are based on recursive Bayesian updates for classification limit the cost of evidence collection through certain stopping/termination criteria and accordingly enforce decision making. Conventionally, two termination criteria based on pre-defined thresholds over (i) the maximum of the state posterior distribution; and (ii) the state posterior uncertainty are commonly used. In this paper, we propose a geometric interpretation over the state posterior progression and accordingly we provide a point-by-point analysis over the disadvantages of using such conventional termination criteria. For example, through the proposed geometric interpretation we show that confidence thresholds defined over maximum of the state posteriors suffer from stiffness that results in unnecessary evidence collection whereas uncertainty based thresholding methods are fragile to number of categories and terminate prematurely if some state candidates are already discovered to be unfavorable. Moreover, both types of termination methods neglect the evolution of posterior updates. We then propose a new stopping/termination criterion with a geometrical insight to overcome the limitations of these conventional methods and provide a comparison in terms of decision accuracy and speed. We validate our claims using simulations and using real experimental data obtained through a brain computer interfaced typing system.

READ FULL TEXT

page 8

page 10

research
02/25/2019

Dependent choice as a termination principle

We introduce a new formulation of the axiom of dependent choice that can...
research
11/24/2015

Stopping criteria for boosting automatic experimental design using real-time fMRI with Bayesian optimization

Bayesian optimization has been proposed as a practical and efficient too...
research
03/23/2020

A termination criterion for stochastic gradient descent for binary classification

We propose a new, simple, and computationally inexpensive termination te...
research
02/09/2012

Active Bayesian Optimization: Minimizing Minimizer Entropy

The ultimate goal of optimization is to find the minimizer of a target f...
research
02/19/2018

Size-based termination of higher-order rewriting

We provide a general and modular criterion for the termination of simply...
research
06/11/2013

Stopping Criterion for the Mean Shift Iterative Algorithm

Image segmentation is a critical step in computer vision tasks constitut...

Please sign up or login with your details

Forgot password? Click here to reset