Privacy Aware Experiments without Cookies

11/03/2022
by   Shiv Shankar, et al.
0

Consider two brands that want to jointly test alternate web experiences for their customers with an A/B test. Such collaborative tests are today enabled using third-party cookies, where each brand has information on the identity of visitors to another website. With the imminent elimination of third-party cookies, such A/B tests will become untenable. We propose a two-stage experimental design, where the two brands only need to agree on high-level aggregate parameters of the experiment to test the alternate experiences. Our design respects the privacy of customers. We propose an estimater of the Average Treatment Effect (ATE), show that it is unbiased and theoretically compute its variance. Our demonstration describes how a marketer for a brand can design such an experiment and analyze the results. On real and simulated data, we show that the approach provides valid estimate of the ATE with low variance and is robust to the proportion of visitors overlapping across the brands.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/03/2023

Testing for idiosyncratic Treatment Effect Heterogeneity

This paper provides asymptotically valid tests for the null hypothesis o...
research
10/16/2022

Design-Based Confidence Sequences for Anytime-valid Causal Inference

Many organizations run thousands of randomized experiments, or A/B tests...
research
07/13/2021

On SDVS Sender Privacy In The Multi-Party Setting

Strong designated verifier signature schemes rely on sender-privacy to h...
research
01/25/2019

A Discrepancy-Based Design for A/B Testing Experiments

The aim of this paper is to introduce a new design of experiment method ...
research
11/19/2019

Principal Stratification for Advertising Experiments

Advertising experiments often suffer from noisy responses making precise...
research
10/02/2016

An Optimal Treatment Assignment Strategy to Evaluate Demand Response Effect

Demand response is designed to motivate electricity customers to modify ...
research
11/01/2018

Profit-Maximizing A/B Tests

Marketers often use A/B testing as a tactical tool to compare marketing ...

Please sign up or login with your details

Forgot password? Click here to reset