Covariate Balancing Based on Kernel Density Estimates for Controlled Experiments

08/12/2020
by   Yiou Li, et al.
0

Controlled experiments are widely used in many applications to investigate the causal relationship between input factors and experimental outcomes. Completely random design is usually used to randomly assign treatment levels to test units. When covariates of the test units are available, the experimental design should achieve covariate balancing between the treatment groups, such that the statistical inference of the treatment effects is not confounded with any possible effects of covariates. However, covariate imbalance often exists, because the experiment is carried out based on a single realization of the complete randomization. The issue becomes worse when the size of the test units is small or moderate. In this paper, we introduce a new covariate balancing criterion, which measures the differences between kernel density estimates of the covariates of treatment groups. To achieve covariate balancing before the treatments are randomly assigned, we partition the test units by minimizing the criterion, then randomly assign the treatment levels to the partitioned groups. Through numerical examples, we show that the proposed partition approach can improve the accuracy of the difference-in-mean estimator. It outperforms the complete randomization and rerandomization approaches.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/14/2023

Bayesian Criterion for Re-randomization

Re-randomization has gained popularity as a tool for experiment-based ca...
research
01/21/2023

Inference for Two-stage Experiments under Covariate-Adaptive Randomization

This paper studies inference in two-stage randomized experiments with co...
research
01/25/2019

A Discrepancy-Based Design for A/B Testing Experiments

The aim of this paper is to introduce a new design of experiment method ...
research
07/14/2020

Network Flow Methods for the Minimum Covariates Imbalance Problem

The problem of balancing covariates arises in observational studies wher...
research
10/25/2021

Covariate Balancing Methods for Randomized Controlled Trials Are Not Adversarially Robust

The first step towards investigating the effectiveness of a treatment is...
research
05/21/2019

The P-LOOP Estimator: Covariate Adjustment for Paired Experiments

In paired experiments, participants are grouped into pairs with similar ...
research
03/03/2022

Online Balanced Experimental Design

e consider the experimental design problem in an online environment, an ...

Please sign up or login with your details

Forgot password? Click here to reset