DeepAI AI Chat
Log In Sign Up

Incentive Compatible Active Learning

11/12/2019
by   Federico Echenique, et al.
Carnegie Mellon University
California Institute of Technology
0

We consider active learning under incentive compatibility constraints. The main application of our results is to economic experiments, in which a learner seeks to infer the parameters of a subject's preferences: for example their attitudes towards risk, or their beliefs over uncertain events. By cleverly adapting the experimental design, one can save on the time spent by subjects in the laboratory, or maximize the information obtained from each subject in a given laboratory session; but the resulting adaptive design raises complications due to incentive compatibility. A subject in the lab may answer questions strategically, and not truthfully, so as to steer subsequent questions in a profitable direction. We analyze two standard economic problems: inference of preferences over risk from multiple price lists, and belief elicitation in experiments on choice over uncertainty. In the first setting, we tune a simple and fast learning algorithm to retain certain incentive compatibility properties. In the second setting, we provide an incentive compatible learning algorithm based on scoring rules with query complexity that differs from obvious methods of achieving fast learning rates only by subpolynomial factors. Thus, for these areas of application, incentive compatibility may be achieved without paying a large sample complexity price.

READ FULL TEXT

page 1

page 2

page 3

page 4

02/20/2020

No-Regret and Incentive-Compatible Online Learning

We study online learning settings in which experts act strategically to ...
04/27/2022

How Much is Performance Worth to Users? A Quantitative Approach

Architects and systems designers artfully balance multiple competing des...
02/03/2020

Limitations of Incentive Compatibility on Discrete Type Spaces

In the design of incentive compatible mechanisms, a common approach is t...
01/05/2021

Incentive-Compatible Forecasting Competitions

We initiate the study of incentive-compatible forecasting competitions i...
01/21/2019

Online Learning for Measuring Incentive Compatibility in Ad Auctions

In this paper we investigate the problem of measuring end-to-end Incenti...
05/23/2016

Actively Learning Hemimetrics with Applications to Eliciting User Preferences

Motivated by an application of eliciting users' preferences, we investig...
12/03/2018

Recommending Paths: Follow or Not Follow?

Mobile social network applications constitute an important platform for ...