DeepAI AI Chat
Log In Sign Up

Analysing e-Commerce A/B Tests with Dependent Data: Empirical Evidence on Measurement Uncertainty in Average Basket Value and Other e-Commerce KPIs

10/31/2022
by   C. H. Bryan Liu, et al.
0

Digital technology organizations often use A/B tests to guide their product and business decisions. In e-commerce, it is a common pitfall to ignore dependent transaction/item value and size that arises when one measure changes to key performance indices such as Average Basket Value (ABV), Average Basket Size (ABS), and Average Selling Price (ASP). We present empirical evidence on dependent transaction value/size, its impact on measurement uncertainty, and practical implications on A/B test outcomes if left unmitigated. By making the evidence available, we hope to drive awareness of the pitfall among experimenters in e-commerce and hence the adoption of many established mitigation approaches.

READ FULL TEXT

page 1

page 2

page 3

page 4

02/24/2021

Property Business Classification Model Based on Indonesia E-Commerce Data

Online property business or known as e-commerce is currently experiencin...
07/01/2017

A Modern Approach to Integrate Database Queries for Searching E-Commerce Product

E commerce refers to the utilization of electronic data transmission for...
11/14/2018

Predictive Modeling with Delayed Information: a Case Study in E-commerce Transaction Fraud Control

In Business Intelligence, accurate predictive modeling is the key for pr...
08/22/2021

E-commerce for Rural Micro-Entrepreneurs: Mapping Restrictions, Ecologies of Use and Trends for Development

This paper addresses the struggle of rural micro-entrepreneurs in the Gl...
07/05/2021

Machine Learning for Fraud Detection in E-Commerce: A Research Agenda

Fraud detection and prevention play an important part in ensuring the su...
05/22/2020

Scanner data in inflation measurement: from raw data to price indices

Scanner data offer new opportunities for CPI or HICP calculation. They c...