DeepAI AI Chat
Log In Sign Up

What is the value of experimentation measurement?

09/08/2019
by   C. H. Bryan Liu, et al.
0

Experimentation and Measurement (E M) capabilities allow organizations to accurately assess the impact of new propositions and to experiment with many variants of existing products. However, until now, the question of measuring the measurer, or valuing the contribution of an E M capability to organizational success has not been addressed. We tackle this problem by analyzing how, by decreasing estimation uncertainty, E M platforms allow for better prioritization. We quantify this benefit in terms of expected relative improvement in the performance of all new propositions and provide guidance for how much an E M capability is worth and when organizations should invest in one.

READ FULL TEXT

page 1

page 2

page 3

page 4

02/19/2019

UPCASE - A Method for Self-Assessing the Capability of the Usability Process in Small Organizations

Designing usable products is important to provide a competitive edge thr...
12/01/2021

Towards Futuristic Autonomous Experimentation–A Surprise-Reacting Sequential Experiment Policy

An autonomous experimentation platform in manufacturing is supposedly ca...
04/24/2019

Risky Business: Assessing Security with External Measurements

Security practices in large organizations are notoriously difficult to a...
11/03/2021

Quantifying the Value of Iterative Experimentation

Over the past decade, most technology companies and a growing number of ...
04/14/2021

Enhancing Strategic Information Security Management in Organizations through Information Warfare Practices

In this short paper we argue that to combat APTs, organizations need a s...
02/14/2020

PushdownDB: Accelerating a DBMS using S3 Computation

This paper studies the effectiveness of pushing parts of DBMS analytics ...

Code Repositories

value_of_experimentation

Code and supplementary documents for the paper "What is the value of experimentation & measurement?"


view repo