Bounded Rationality in Las Vegas: Probabilistic Finite Automata PlayMulti-Armed Bandits

by   Xinming Liu, et al.

While traditional economics assumes that humans are fully rational agents who always maximize their expected utility, in practice, we constantly observe apparently irrational behavior. One explanation is that people have limited computational power, so that they are, quite rationally, making the best decisions they can, given their computational limitations. To test this hypothesis, we consider the multi-armed bandit (MAB) problem. We examine a simple strategy for playing an MAB that can be implemented easily by a probabilistic finite automaton (PFA). Roughly speaking, the PFA sets certain expectations, and plays an arm as long as it meets them. If the PFA has sufficiently many states, it performs near-optimally. Its performance degrades gracefully as the number of states decreases. Moreover, the PFA acts in a "human-like" way, exhibiting a number of standard human biases, like an optimism bias and a negativity bias.



There are no comments yet.


page 1

page 2

page 3

page 4


Risk-Averse Biased Human Policies in Assistive Multi-Armed Bandit Settings

Assistive multi-armed bandit problems can be used to model team situatio...

An Asymptotically Optimal Strategy for Constrained Multi-armed Bandit Problems

For the stochastic multi-armed bandit (MAB) problem from a constrained m...

The Assistive Multi-Armed Bandit

Learning preferences implicit in the choices humans make is a well studi...

Decision Theory with Resource-Bounded Agents

There have been two major lines of research aimed at capturing resource-...

A Hoeffding Inequality for Finite State Markov Chains and its Applications to Markovian Bandits

This paper develops a Hoeffding inequality for the partial sums ∑_k=1^n ...

Response Prediction for Low-Regret Agents

Companies like Google and Microsoft run billions of auctions every day t...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.