DeepAI AI Chat
Log In Sign Up

Analysing e-Commerce A/B Tests with Dependent Data: Empirical Evidence on Measurement Uncertainty in Average Basket Value and Other e-Commerce KPIs

by   C. H. Bryan Liu, et al.

Digital technology organizations often use A/B tests to guide their product and business decisions. In e-commerce, it is a common pitfall to ignore dependent transaction/item value and size that arises when one measure changes to key performance indices such as Average Basket Value (ABV), Average Basket Size (ABS), and Average Selling Price (ASP). We present empirical evidence on dependent transaction value/size, its impact on measurement uncertainty, and practical implications on A/B test outcomes if left unmitigated. By making the evidence available, we hope to drive awareness of the pitfall among experimenters in e-commerce and hence the adoption of many established mitigation approaches.


page 1

page 2

page 3

page 4


Property Business Classification Model Based on Indonesia E-Commerce Data

Online property business or known as e-commerce is currently experiencin...

A Modern Approach to Integrate Database Queries for Searching E-Commerce Product

E commerce refers to the utilization of electronic data transmission for...

Predictive Modeling with Delayed Information: a Case Study in E-commerce Transaction Fraud Control

In Business Intelligence, accurate predictive modeling is the key for pr...

E-commerce for Rural Micro-Entrepreneurs: Mapping Restrictions, Ecologies of Use and Trends for Development

This paper addresses the struggle of rural micro-entrepreneurs in the Gl...

Machine Learning for Fraud Detection in E-Commerce: A Research Agenda

Fraud detection and prevention play an important part in ensuring the su...

Scanner data in inflation measurement: from raw data to price indices

Scanner data offer new opportunities for CPI or HICP calculation. They c...