DeepAI AI Chat
Log In Sign Up

Presenting the Probabilities of Different Effect Sizes: Towards a Better Understanding and Communication of Statistical Uncertainty

08/17/2020
by   Akisato Suzuki, et al.
0

How should social scientists understand and communicate the uncertainty of statistically estimated causal effects? It is well-known that the conventional significance-vs.-insignificance approach is associated with misunderstandings and misuses. Behavioral research suggests people understand uncertainty more appropriately in a numerical, continuous scale than in a verbal, discrete scale. Motivated by these backgrounds, I propose presenting the probabilities of different effect sizes. Probability as an intuitive continuous measure of uncertainty allows researchers to better understand and communicate the uncertainty of the statistically estimated effects. In addition, my approach needs no decision threshold for an uncertainty measure or effect size, unlike the conventional approaches, allowing researchers to be agnostic about a decision threshold such as p<5 approach to a previous social scientific study, showing it enables richer inference than the significance-vs.-insignificance approach taken by the original study. The accompanying R package makes my approach easy to implement.

READ FULL TEXT

page 1

page 2

page 3

page 4

08/25/2020

Policy Implications of Statistical Estimates: A General Bayesian Decision-Theoretic Model for Binary Outcomes

How should scholars evaluate the statistically estimated causal effect o...
05/30/2019

Somewhere Around That Number: An Interview Study of How Spreadsheet Users Manage Uncertainty

Spreadsheet users regularly deal with uncertainty in their data, for exa...
12/08/2017

p-Values for Credibility

Analysis of credibility is a reverse-Bayes technique that has been propo...
09/30/2019

Enhancing statistical inference in psychological research via prospective and retrospective design analysis

In the past two decades, psychological science has experienced an unprec...