Log In Sign Up

Covariate Balancing Based on Kernel Density Estimates for Controlled Experiments

by   Yiou Li, et al.

Controlled experiments are widely used in many applications to investigate the causal relationship between input factors and experimental outcomes. Completely random design is usually used to randomly assign treatment levels to test units. When covariates of the test units are available, the experimental design should achieve covariate balancing between the treatment groups, such that the statistical inference of the treatment effects is not confounded with any possible effects of covariates. However, covariate imbalance often exists, because the experiment is carried out based on a single realization of the complete randomization. The issue becomes worse when the size of the test units is small or moderate. In this paper, we introduce a new covariate balancing criterion, which measures the differences between kernel density estimates of the covariates of treatment groups. To achieve covariate balancing before the treatments are randomly assigned, we partition the test units by minimizing the criterion, then randomly assign the treatment levels to the partitioned groups. Through numerical examples, we show that the proposed partition approach can improve the accuracy of the difference-in-mean estimator. It outperforms the complete randomization and rerandomization approaches.


page 1

page 2

page 3

page 4


Rejective Sampling, Rerandomization and Regression Adjustment in Survey Experiments

Classical randomized experiments, equipped with randomization-based infe...

Covariate Balancing Methods for Randomized Controlled Trials Are Not Adversarially Robust

The first step towards investigating the effectiveness of a treatment is...

A Discrepancy-Based Design for A/B Testing Experiments

The aim of this paper is to introduce a new design of experiment method ...

Network Flow Methods for the Minimum Covariates Imbalance Problem

The problem of balancing covariates arises in observational studies wher...

Dynamic covariate balancing: estimating treatment effects over time

This paper discusses the problem of estimation and inference on time-var...

The P-LOOP Estimator: Covariate Adjustment for Paired Experiments

In paired experiments, participants are grouped into pairs with similar ...

Online Balanced Experimental Design

e consider the experimental design problem in an online environment, an ...