DeepAI AI Chat
Log In Sign Up

What is the value of experimentation measurement?

by   C. H. Bryan Liu, et al.

Experimentation and Measurement (E M) capabilities allow organizations to accurately assess the impact of new propositions and to experiment with many variants of existing products. However, until now, the question of measuring the measurer, or valuing the contribution of an E M capability to organizational success has not been addressed. We tackle this problem by analyzing how, by decreasing estimation uncertainty, E M platforms allow for better prioritization. We quantify this benefit in terms of expected relative improvement in the performance of all new propositions and provide guidance for how much an E M capability is worth and when organizations should invest in one.


page 1

page 2

page 3

page 4


UPCASE - A Method for Self-Assessing the Capability of the Usability Process in Small Organizations

Designing usable products is important to provide a competitive edge thr...

Towards Futuristic Autonomous Experimentation–A Surprise-Reacting Sequential Experiment Policy

An autonomous experimentation platform in manufacturing is supposedly ca...

Risky Business: Assessing Security with External Measurements

Security practices in large organizations are notoriously difficult to a...

Quantifying the Value of Iterative Experimentation

Over the past decade, most technology companies and a growing number of ...

Enhancing Strategic Information Security Management in Organizations through Information Warfare Practices

In this short paper we argue that to combat APTs, organizations need a s...

PushdownDB: Accelerating a DBMS using S3 Computation

This paper studies the effectiveness of pushing parts of DBMS analytics ...

Code Repositories


Code and supplementary documents for the paper "What is the value of experimentation & measurement?"

view repo