Qini Curves for Multi-Armed Treatment Rules

06/21/2023
by   Erik Sverdrup, et al.
0

Qini curves have emerged as an attractive and popular approach for evaluating the benefit of data-driven targeting rules for treatment allocation. We propose a generalization of the Qini curve to multiple costly treatment arms, that quantifies the value of optimally selecting among both units and treatment arms at different budget levels. We develop an efficient algorithm for computing these curves and propose bootstrap-based confidence intervals that are exact in large samples for any point on the curve. These confidence intervals can be used to conduct hypothesis tests comparing the value of treatment targeting using an optimal combination of arms with using just a subset of arms, or with a non-targeting assignment rule ignoring covariates, at different budget levels. We demonstrate the statistical performance in a simulation experiment and an application to treatment targeting for election turnout.

READ FULL TEXT
research
11/28/2018

Mixture Martingales Revisited with Applications to Sequential Tests and Confidence Intervals

This paper presents new deviation inequalities that are valid uniformly ...
research
11/15/2021

Evaluating Treatment Prioritization Rules via Rank-Weighted Average Treatment Effects

There are a number of available methods that can be used for choosing wh...
research
01/27/2020

Shapley value confidence intervals for variable selection in regression models

Multiple linear regression is a commonly used inferential and predictive...
research
11/07/2019

Confidence Intervals for Policy Evaluation in Adaptive Experiments

Adaptive experiments can result in considerable cost savings in multi-ar...
research
02/02/2023

Comparing regression curves – an L^1-point of view

In this paper we compare two regression curves by measuring their differ...
research
02/05/2018

Re-thinking non-inferiority: a practical trial design for optimising treatment duration

Background: trials to identify the minimal effective treatment duration ...
research
11/10/2020

Statistical evaluation of in-vivo bioassays in regulatory toxicology considering males and females

The separate evaluation for males and females is the recent standard in ...

Please sign up or login with your details

Forgot password? Click here to reset