DeepAI
Log In Sign Up

Bayesian Persuasion in Sequential Decision-Making

06/09/2021
by   Jiarui Gan, et al.
0

We study a dynamic model of Bayesian persuasion in sequential decision-making settings. An informed principal observes an external parameter of the world and advises an uninformed agent about actions to take over time. The agent takes actions in each time step based on the current state, the principal's advice/signal, and beliefs about the external parameter. The action of the agent updates the state according to a stochastic process. The model arises naturally in many applications, e.g., an app (the principal) can advice the user (the agent) on possible choices between actions based on additional real-time information the app has. We study the problem of designing a signaling strategy from the principal's point of view. We show that the principal has an optimal strategy against a myopic agent, who only optimizes their rewards locally, and the optimal strategy can be computed in polynomial time. In contrast, it is NP-hard to approximate an optimal policy against a far-sighted agent. Further, we show that if the principal has the power to threaten the agent by not providing future signals, then we can efficiently design a threat-based strategy. This strategy guarantees the principal's payoff as if playing against an agent who is far-sighted but myopic to future signals.

READ FULL TEXT

page 1

page 2

page 3

page 4

10/31/2017

Servant of Many Masters: Shifting priorities in Pareto-optimal sequential decision-making

It is often argued that an agent making decisions on behalf of two or mo...
03/17/2020

Dynamic Information Design: A Simple Problem on Optimal Sequential Information Disclosure

We study a dynamic information design problem in a finite-horizon settin...
11/14/2019

Deception through Half-Truths

Deception is a fundamental issue across a diverse array of settings, fro...
02/22/2022

Designing Menus of Contracts Efficiently: The Power of Randomization

We study hidden-action principal-agent problems in which a principal com...
06/07/2021

Stateful Strategic Regression

Automated decision-making tools increasingly assess individuals to deter...
02/21/2022

Selling to a principal and a budget-constrained agent

We analyze a model of selling a single object to a principal-agent pair ...
05/13/2021

Automated Dynamic Mechanism Design

We study Bayesian automated mechanism design in unstructured dynamic env...