PowerGraph: Using neural networks and principal components to multivariate statistical power trade-offs

12/29/2021
by   Ajinkya K Mulay, et al.
0

It is increasingly acknowledged that a priori statistical power estimation for planned studies with multiple model parameters is inherently a multivariate problem. Power for individual parameters of interest cannot be reliably estimated univariately because sampling variably in, correlation with, and variance explained relative to one parameter will impact the power for another parameter, all usual univariate considerations being equal. Explicit solutions in such cases, especially for models with many parameters, are either impractical or impossible to solve, leaving researchers with the prevailing method of simulating power. However, point estimates for a vector of model parameters are uncertain, and the impact of inaccuracy is unknown. In such cases, sensitivity analysis is recommended such that multiple combinations of possible observable parameter vectors are simulated to understand power trade-offs. A limitation to this approach is that it is computationally expensive to generate sufficient sensitivity combinations to accurately map the power trade-off function in increasingly high dimensional spaces for the models that social scientists estimate. This paper explores the efficient estimation and graphing of statistical power for a study over varying model parameter combinations. Optimally powering a study is crucial to ensure a minimum probability of finding the hypothesized effect. We first demonstrate the impact of varying parameter values on power for specific hypotheses of interest and quantify the computational intensity of computing such a graph for a given level of precision. Finally, we propose a simple and generalizable machine learning inspired solution to cut the computational cost to less than 7% of what could be called a brute force approach. [abridged]

READ FULL TEXT
research
09/01/2022

A Genetic Algorithm-based Framework for Learning Statistical Power Manifold

Statistical power is a measure of the replicability of a categorical hyp...
research
09/17/2019

Robust statistical modeling of monthly rainfall: The minimum density power divergence approach

Statistical modeling of rainfall is an important challenge in meteorolog...
research
08/24/2017

Global sensitivity analysis for statistical model parameters

Global sensitivity analysis (GSA) is frequently used to analyze the infl...
research
10/06/2020

Comprehending finger flexor tendon pulley system using a computational analysis

Existing prosthetic/orthotic designs are rarely based on kinetostatics o...
research
10/25/2019

Components of Machine Learning: Binding Bits and FLOPS

Many machine learning problems and methods are combinations of three com...
research
04/14/2020

A Sensitivity Matrix Based Methodology for Inverse Problem Formulation

We propose an algorithm to select parameter subset combinations that can...
research
09/20/2021

Differentially Evolving Memory Ensembles: Pareto Optimization based on Computational Intelligence for Embedded Memories on a System Level

As the relative power, performance, and area (PPA) impact of embedded me...

Please sign up or login with your details

Forgot password? Click here to reset