Analytically Tractable Models for Decision Making under Present Bias

02/16/2023
by   Yasunori Akagi, et al.
0

Time-inconsistency is a characteristic of human behavior in which people plan for long-term benefits but take actions that differ from the plan due to conflicts with short-term benefits. Such time-inconsistent behavior is believed to be caused by present bias, a tendency to overestimate immediate rewards and underestimate future rewards. It is essential in behavioral economics to investigate the relationship between present bias and time-inconsistency. In this paper, we propose a model for analyzing agent behavior with present bias in tasks to make progress toward a goal over a specific period. Unlike previous models, the state sequence of the agent can be described analytically in our model. Based on this property, we analyze three crucial problems related to agents under present bias: task abandonment, optimal goal setting, and optimal reward scheduling. Extensive analysis reveals how present bias affects the condition under which task abandonment occurs and optimal intervention strategies. Our findings are meaningful for preventing task abandonment and intervening through incentives in the real world.

READ FULL TEXT
research
06/21/2021

Stochastic Model for Sunk Cost Bias

We present a novel model for capturing the behavior of an agent exhibiti...
research
12/06/2021

Inconsistent Planning: When in doubt, toss a coin!

One of the most widespread human behavioral biases is the present bias –...
research
07/27/2011

Time Consistent Discounting

A possibly immortal agent tries to maximise its summed discounted reward...
research
01/10/2013

The Optimal Reward Baseline for Gradient-Based Reinforcement Learning

There exist a number of reinforcement learning algorithms which learnby ...
research
10/19/2020

Paid and hypothetical time preferences are the same: Lab, field and online evidence

The use of hypothetical instead of real decision-making incentives remai...
research
08/25/2017

The Price of Uncertainty in Present-Biased Planning

The tendency to overestimate immediate utility is a common cognitive bia...
research
09/24/2019

Active Goal Recognition

To coordinate with other systems, agents must be able to determine what ...

Please sign up or login with your details

Forgot password? Click here to reset