Balancing Suspense and Surprise: Timely Decision Making with Endogenous Information Acquisition

10/24/2016
by   Ahmed M. Alaa, et al.
0

We develop a Bayesian model for decision-making under time pressure with endogenous information acquisition. In our model, the decision maker decides when to observe (costly) information by sampling an underlying continuous-time stochastic process (time series) that conveys information about the potential occurrence or non-occurrence of an adverse event which will terminate the decision-making process. In her attempt to predict the occurrence of the adverse event, the decision-maker follows a policy that determines when to acquire information from the time series (continuation), and when to stop acquiring information and make a final prediction (stopping). We show that the optimal policy has a rendezvous structure, i.e. a structure in which whenever a new information sample is gathered from the time series, the optimal "date" for acquiring the next sample becomes computable. The optimal interval between two information samples balances a trade-off between the decision maker's surprise, i.e. the drift in her posterior belief after observing new information, and suspense, i.e. the probability that the adverse event occurs in the time interval between two information samples. Moreover, we characterize the continuation and stopping regions in the decision-maker's state-space, and show that they depend not only on the decision-maker's beliefs, but also on the context, i.e. the current realization of the time series.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/01/2022

ECOTS: Early Classification in Open Time Series

Learning to predict ahead of time events in open time series is challeng...
research
10/22/2020

Predicting Human Decision Making in Psychological Tasks with Recurrent Neural Networks

Unlike traditional time series, the action sequences of human decision m...
research
03/30/2022

Theory of Acceleration of Decision Making by Correlated Times Sequences

Photonic accelerators have been intensively studied to provide enhanced ...
research
10/06/2018

Discretizing Logged Interaction Data Biases Learning for Decision-Making

Time series data that are not measured at regular intervals are commonly...
research
03/29/2017

Optimal Policies for Observing Time Series and Related Restless Bandit Problems

The trade-off between the cost of acquiring and processing data, and unc...
research
05/12/2019

Note on Thompson sampling for large decision problems

There is increasing interest in using streaming data to inform decision ...

Please sign up or login with your details

Forgot password? Click here to reset