What is the value of experimentation measurement?

09/08/2019
by   C. H. Bryan Liu, et al.
0

Experimentation and Measurement (E M) capabilities allow organizations to accurately assess the impact of new propositions and to experiment with many variants of existing products. However, until now, the question of measuring the measurer, or valuing the contribution of an E M capability to organizational success has not been addressed. We tackle this problem by analyzing how, by decreasing estimation uncertainty, E M platforms allow for better prioritization. We quantify this benefit in terms of expected relative improvement in the performance of all new propositions and provide guidance for how much an E M capability is worth and when organizations should invest in one.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/19/2019

UPCASE - A Method for Self-Assessing the Capability of the Usability Process in Small Organizations

Designing usable products is important to provide a competitive edge thr...
research
12/01/2021

Towards Futuristic Autonomous Experimentation–A Surprise-Reacting Sequential Experiment Policy

An autonomous experimentation platform in manufacturing is supposedly ca...
research
08/11/2023

Improving Ego-Cluster for Network Effect Measurement

Network effect is common in social network platforms. Many new features ...
research
04/24/2019

Risky Business: Assessing Security with External Measurements

Security practices in large organizations are notoriously difficult to a...
research
02/22/2022

Registered Report: A Laboratory Experiment on Using Different Financial-Incentivization Schemes in Software-Engineering Experimentation

Empirical studies in software engineering are often conducted with open-...
research
10/01/2017

Leaky Abstraction In Online Experimentation Platforms: A Conceptual Framework To Categorize Common Challenges

Online experimentation platforms abstract away many of the details of ex...
research
02/14/2020

PushdownDB: Accelerating a DBMS using S3 Computation

This paper studies the effectiveness of pushing parts of DBMS analytics ...

Please sign up or login with your details

Forgot password? Click here to reset