Bayesian A/B Testing for Business Decisions

03/05/2020
by   Shafi Kamalbasha, et al.
0

Controlled experiments (A/B tests or randomized field experiments) are the de facto standard to make data-driven decisions when implementing changes and observing customer responses. The methodology to analyze such experiments should be easily understandable to stakeholders like product and marketing managers. Bayesian inference recently gained a lot of popularity and, in terms of A/B testing, one key argument is the easy interpretability. For stakeholders, "probability to be best" (with corresponding credible intervals) provides a natural metric to make business decisions. In this paper, we motivate the quintessential questions a business owner typically has and how to answer them with a Bayesian approach. We present three experiment scenarios that are common in our company, how they are modeled in a Bayesian fashion, and how to use the models to draw business decisions. For each of the scenarios, we present a real-world experiment, the results and the final business decisions drawn.

READ FULL TEXT

page 1

page 3

research
09/13/2021

Augmenting Decision Making via Interactive What-If Analysis

The fundamental goal of business data analysis is to improve business de...
research
05/28/2023

SAP HANA Data Volume Management

Today information technology is a data-driven environment. The role of d...
research
12/27/2022

Predictive and Prescriptive Analytics in Business Decision Making: Needs and Concerns

Business users make data-informed decisions by understanding the relatio...
research
07/12/2020

Bayesian probabilistic models for corporate context, with an application to internal audit activities

In this paper we present a business case carried out in Poste Italiane, ...
research
08/09/2021

Extending LIME for Business Process Automation

AI business process applications automate high-stakes business decisions...
research
03/08/2018

QREME - Quality Requirements Management Model for Supporting Decision-Making

[Context and motivation] Quality requirements (QRs) are inherently diffi...
research
10/03/2018

Discriminative Data-driven Self-adaptive Fraud Control Decision System with Incomplete Information

While E-commerce has been growing explosively and online shopping has be...

Please sign up or login with your details

Forgot password? Click here to reset