DeepAI AI Chat
Log In Sign Up

Incentive Compatible Active Learning

by   Federico Echenique, et al.
Carnegie Mellon University
California Institute of Technology

We consider active learning under incentive compatibility constraints. The main application of our results is to economic experiments, in which a learner seeks to infer the parameters of a subject's preferences: for example their attitudes towards risk, or their beliefs over uncertain events. By cleverly adapting the experimental design, one can save on the time spent by subjects in the laboratory, or maximize the information obtained from each subject in a given laboratory session; but the resulting adaptive design raises complications due to incentive compatibility. A subject in the lab may answer questions strategically, and not truthfully, so as to steer subsequent questions in a profitable direction. We analyze two standard economic problems: inference of preferences over risk from multiple price lists, and belief elicitation in experiments on choice over uncertainty. In the first setting, we tune a simple and fast learning algorithm to retain certain incentive compatibility properties. In the second setting, we provide an incentive compatible learning algorithm based on scoring rules with query complexity that differs from obvious methods of achieving fast learning rates only by subpolynomial factors. Thus, for these areas of application, incentive compatibility may be achieved without paying a large sample complexity price.


page 1

page 2

page 3

page 4


No-Regret and Incentive-Compatible Online Learning

We study online learning settings in which experts act strategically to ...

How Much is Performance Worth to Users? A Quantitative Approach

Architects and systems designers artfully balance multiple competing des...

Limitations of Incentive Compatibility on Discrete Type Spaces

In the design of incentive compatible mechanisms, a common approach is t...

Incentive-Compatible Forecasting Competitions

We initiate the study of incentive-compatible forecasting competitions i...

Online Learning for Measuring Incentive Compatibility in Ad Auctions

In this paper we investigate the problem of measuring end-to-end Incenti...

Actively Learning Hemimetrics with Applications to Eliciting User Preferences

Motivated by an application of eliciting users' preferences, we investig...

Recommending Paths: Follow or Not Follow?

Mobile social network applications constitute an important platform for ...